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Implementation  of  FSTV  is  based  on  a  preliminary  design  of 
Functional  Hierarchy  presented  in  <Hsu80>.  In  that  design,  data 
base  management  functions  are  decomposed  into  hierarchical 
levels,  each  level  to  be  implemented  as  a  level  of  Functional 
Hierarchy.  The  current  version  of  FSTV  is  implemented  with 
special  attention  paid  to  a  richer  set  of  data  base  capabilities 
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1.0  OVERVIEW  OF  THE  REPORT 


This  report  describes  in  detail  the  current  implementation  of 
the  software  test  vehicle  (STV)  for  Functional  Hierarchy  of 
INFOPLEX  data  base  computer.  The  basic  concepts  of  INFOPLEX  are 
found  in  <Madnick  78>  and  the  reader  is  assumed  to  have  some 
understanding  of  the  proposed  architecture  of  this  data  base 
computer . 

The  purpose  of  STV  is  to  provide  a  better  understanding  of  the 
architecture  and  funcitonalities  of  the  INFOPLEX  design  by 
emulating  its  architecture  and  simulating  its  functionalities  in 
software.  It  aims  at  validating  the  communication  protocols 
among  its  various  components,  tightening  functional  algorithms 
for  database  management  and  data  movements,  providing  behavioral 
and  preliminary  performance  information  concerning  the 
architecture,  and  serving  as  a  test  bed  before  realizing  the 
design  in  the  hardware  prototype. 

The  STV  project  is  divided  into  the  Functional  Hierarchy  STV 
(FSTV)  and  the  Storage  Hierarchy  STV  (SSTV).  In  addition,  there 
is  a  Control  Structure  Program  which  provides  an  emulation  of  the 
multi-level  multi-processing  hardware  architecture  and 
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communication  protocols.  FSTV  and  SSTV  are  to  be  developed 
separately,  each  integrated  with  a  separate  copy  of  the  Control 
Structure  Program.  However,  the  eventual  goal  is  to  produce  an 
integrated  version,  in  which  FSTV  and  SSTV  are  coupled  together 
through  a  single  copy  of  the  Control  Structure  Program. 

Implementation  of  FSTV  is  based  on  a  preliminary  design  of 
Functional  Hierarchy  presented  in  <Hsu80>.  In  that  design,  data 
base  management  functions  are  decomposed  into  hierarchical 
levels,  each  level  to  be  implemented  as  a  level  of  Functional 
Hierarchy.  A  3-level  version  of  FSTV  was  implemented  by  Bruce 
Blumberg  <Blumberg81> .  His  implementation  followed  the 
philosophy  of  hierarchical  decomposition  and  incorporated  many 
distictive  features.  However,  his  version  did  not  take  the 
hardware  architecture  of  Functional  Hierarchy  into  account,  and 
could  not  be  integrated  with  the  Control  Structure.  Based  on  his 
experience  and  the  availability  of  a  Control  Structure 
implemented  by  Tak  To  <To81>,  the  current  version  of  FSTV  is 
implemented  with  special  attention  paid  to  a  richer  set  of  data 
base  capabilities  and  architectural  corroatibili ty . 

This  report  is  divided  into  6  chapters.  The  next  chapter 
provides  an  overview  of  the  functionalities  of  FSTV  as  a  data 
base  management  system:  what  it  does,  what  data  model  it 
implements,  and  how  it  interacts  with  the  user.  Chapter  three 
provides  a  description  of  the  implementation  character i st ics  of 
FSTV.  In  particular,  it  contains  conventions  used  to  preserve 
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architectural  compatibility  and  to  interface  with  the  Control 
Structure.  Chapter  four  and  five  are  primarily  program 
documentation.  A  description  of  a  set  of  service  routines 
devised  to  ease  the  task  of  interfacing  with  the  Control  Structre 
is  presented  in  Chapter  four,  while  Chapter  five  contains  an 
explanation  of  functional  program  modules  in  the  current 
implementation.  Chapter  six  concludes  this  report  by  pointing 
out  directions  for  future  refinement.  A  sample  terminal  session 
is  included  in  Appendix  1.  Appendix  2  contains  a  list  of  Control 
Blocks  (used  as  inter-level  interface)  and  external/static 
variables.  Finally,  a  complete  program  listing  is  found  in 
Appendix  3. 
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2.0  OVERVIEW  OF  DATA  BASE  SYSTEM  CAPABILITIES  OF  FSTV 


FSTV  currently  implements  a  subset  of  functionalities  proposed 
in  the  preliminary  design  <Hsu80>.  The  proposed  architecture  with 
respect  to  data  abstraction  is  similar  to  that  of  the  ANSI/SPARC 
design,  basically  a  3-level  architecture  which  contains  an 
external  schema  level,  a  conceptual  schema  level  and  an  internal 
schema  level.  In  our  design,  however,  we  have  added  a  base  data 
model  schema  level  to  capture  data  definition  of  the  integrated 
data  base  and  to  support  multiple  conceptual  schemas  defined  on 
top  of,  and  mapped  to,  the  base  data  model  schema.  This  way,  a 
conceptual  schema  may  use  a  data  model  which  is  different  from 
that  of  the  base  schema,  effecting  support  of  a  multiple  data 
model  data  base  management  system.  External  schemas  can  then  be 
defined  on  top  of,  and  mapped  to,  a  conceptual  schema.  This 
4-level  architecture  is  depicted  in  the  following  figure. 
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View 
Facil ity 


Figure:  Architecture  of  INFOPLEX  with  respect  to  data  abstraction 


The  upper  two  levels  in  the  figure  are  aggregatedly  called  the 
veiw  facility.  In  the  current  version,  the  view  facility  is  not 
availale,  and  the  base  data  model  implemented  at  the  base  schema 
level  is  an  entity  network  data  model.  Therefore,  this  level  is 
called  the  Base  Schema  Level  or  the  Entity  Level  in  FSTV. 

This  overview  chapter  describes  what  the  system  can  do  and  how 
a  user  may  interact  with  the  system.  It  also  provides  a  brief 
description  of  the  entity  network  data  model  and  the  internal 
schema  used  in  FSTV.  A  sample  terminal  session  is  included  in 
the  Appendix. 


2.1  STRUCTURE  OF  USER  SESSION 

FSTV  interacts  with  a  user  through  a  user  session  in  the  User 
Interface  Level.  Since  currently  only  the  DBA  session  is 
available,  the  user  will  enter  the  DBA  session,  in  which  he  may 
define  or  manipulate  the  database.  If  the  former  is  chosen,  a 
data  definition  session  is  initiated.  If  the  user  chooses  data 
manipulation,  then  he  may  create,  delete,  modify  and  query  the 
database.  The  User  Interface  Level  guides  the  user  into  the 
desired  seeion  and  then  accepts  input  strings,  parses  them  and 
formulates  proper  requests  to  go  down  to  the  next  level.  It  also 
displays  error  messages  or  return  data  at  the  user’s  terminal 
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based  on  the  return  from  the  next  level.  The  structure  of  the 
user  interface  is  depicted  in  the  following  figure. 
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(not  imple¬ 
mented  ) 


Figure:  Structure  of  the  User  Sessions 
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2.2  DATA  DEFINITION  SESSION 


The  DBA  defines  the  data  base  in  an  entity  network  data  model. 
This  model  views  the  world  as  a  collection  of  entities  and 
attributes  of  these  entities.  Generically  similar  entities  are 
grouped  into  entity  sets.  Entities  in  one  entity  set  will  share 
the  same  set  of  attributes. 

The  DBA  will  model  the  application  environment  into  entity 
sets.  For  each  entity  set,  he  may  define  an  arbitrary  number  of 
attributes.  The  domain  of  an  attribute  can  be  either  a  value  set 
or  an  entity  set.  It  is  through  the  latter  that  the  entity  sets 
defined  can  be  made  to  explicitly  relate  to  each  other  and  form  a 
network . 

This  entity  network  data  model  bears  many  properties  that 
recent  research  in  the  area  of  data  modelling  has  advocated.  Its 
basic  principles  are  outlined  in  <Hsu80>  and  a  draft  of  a 
detailed  description  of  this  model,  including  its  retrieval  and 
update  primitives,  is  forthcoming.  However,  the  current 
implementation  extracts  only  a  subset  of  its  intended  set  of 
semantics.  In  particular,  concepts  such  as  generalization  and 
inter-entity-set  aggregation  are  not  provided.  A  virtual 
information  facility  is  also  lacking.  Nevertheless,  the  basic 
structure  of  the  data  model  is  preserved  such  that  additional 
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semantics  may  be  added  to  without  a  complete  rewrite  of  the 
current  implementation. 

Before  we  describe  the  data  definition  session  in  detail,  we 
remind  the  reader  of  a  few  definitions  used  in  the  entity  network 
data  model.  An  attribute  with  a  value  set  as  its  domain  is 
called  a  value  attribute;  on  the  other  hand,  if  its  domain  is  an 
entity  set,  the  attribute  is  called  an  entity  attribute.  Also,  a 
direct  attribute  is  an  attribute  which  is  directly  related  to  the 
entity  set.  In  contrast,  a  derived  attribute  is  an  attribute  of 
an  attribute.  For  example,  in  the  following  figure  which 
describes  an  entity  network  data  base  schema,  EMPNAME  is  a  direct 
attribute  of  the  entity  set  EMPLOYEE,  while  DEPTNUM  is  a  derived 
attribute  of  EMPLOYEE  because  it  is  a  direct  attribute  of  the 
entity  set  DEPT,  which  in  turn  is  the  domain  of  the  WORKS_IN 
attribute  of  EMPLOYEE. 
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EMPLOYEE 


Entity  Set 


Value  Set 


— *  :  Attribute 


Figure:  An  Example  of  the  Entity  Network  Schema 
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The  Base  Scehma  Level,  as  currently  implemented,  will  accept 
definitions  of  entity  sets  and  their  attributes.  To  define  the 
base  schema,  the  DBA  enters  the  Base  Schema  Data  Definitionn 
Session.  An  entity  set  is  to  be  defined  by  giving  an  entity  set 
name.  An  attribute  definition,  on  the  other  hand,  includes  the 
name  of  the  attribute,  its  domain  type  (i.e.,  value  set  or  entity 
set),  and  its  funciton  type  (i.e.,  many-to-one,  one-to-one,  or 
key).  If  the  attribute  is  a  value  attribute,  the  definition 
also  specifies  the  value  type  (i.e.,  numeric  or  character)  and 
maximum  length  of  the  value  (in  number  of  characters),  and  if  the 
value  type  is  numeric,  the  allowable  numeric  range.  If  it  is  an 
entity  attribute,  only  the  name  of  the  domain  entity  set  need  be 
given . 

To  facilitate  ease  of  use,  the  user  is  provided  with  a  panel 
to  describe  the  data  definition.  Appropriate  prompts  are  given 
in  the  panel. 

Data  definition  can  be  incremental;  i.e.,  new  entity  sets  and 
additional  attributes  for  existing  entity  sets  may  be  defined 
after  some  data  has  been  inserted  into  existing  entity  sets. 


2 . 3  DATA  DEFINITION  QUERY  SESSION 


A  user  may  choose  to  enter  this  session  to  discover  what  entity 
sets  and  attributes  have  been  defined  for  the  database.  He  may 
choose  to  look  at  the  definition  of  all  entity  sets  or  that  of  a 
particular  entity  set.  He  may  also  choose  to  look  at  the 
definition  of  all  attributes  of  an  entity  set  or  that  of  a 
particular  attribute.  The  system  will  provide  appropriate 
prompts  as  the  user  proceeds. 


2.4  DATA  MANIPULATION  SESSION 

In  an  entity  network  data  base,  entities  may  be  created  and 
deleted.  Attribute  values  can  be  inserted,  modified  or  deleted. 
A  non-procedural  query  language  can  be  used  to  retrieve 
information  from  the  database.  To  do  these,  the  user  will  get 
into  the  data  manipulation  session. 


2.4.1  DATABSASE  QUERY 

To  do  a  query,  the  user  enters  the  Query  Subsession.  He  will 
give  the  name  of  the  entity  set  and  a  list  of  attribute  names  of 
this  entity  set  he  would  like  to  see.  If  any  of  the  attributes 
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has  a  predicate  (e.g.,  >150,  ='Stu  Madnick'),  the  user  will  give 
it  along  with  the  attribute  list.  Multiple  predicates  are 
allowed  on  an  'AND'  basis.  (No  'OR'  capability  is  provided  for 
in  the  current  version.) 

The  attribute  list  may  also  include  derived  attributes.  The 
user  expresses  the  derived  attribute  as  a  series  of  direct 
attributes  that  would  lead  to  that  derived  attribute.  For 
example,  the  city  of  the  main  location  of  the  department  an 
employee  works  in,  using  the  example  database  shown  in  the  above 
figure,  is  expressed  by 

WORKS_IN  (MAIN_LOC  (CITY)) 

as  a  derived  attribute  of  the  employee  entity.  The  derivation 
path  can  be  arbitrarily  deep.  An  example  query  statement  is 
given  below: 

EMPLOYEE 

EMPNAME,  EMPADDR ,  AGE  >  50,  WORKS_IN  (DEPTNUM  =  15) 

This  query  wants  the  employee  name,  address,  age  and  the 
department  number  of  the  department  the  employee  works  in,  for 
those  employees  whose  ages  are  greater  than  50  and  who  work  in 
department  number  15. 
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2.4.2  CREATING  ENTITIES 


To  create  entities,  the  user  enters  the  Create  Subsession. 
The  user  will  give  the  name  of  the  entity  set  he  is  to  create 
entities  for,  and  a  list  of  attributes  that  he  will  give  values 
to.  He  then  will  provide  the  values  of  these  attributes  at  the 
prompt  for  data.  The  attribute  list  may  include  derived 
attributes,  in  which  case  the  value  given  for  that  attribute  is 
used  to  identify  an  existing  entity  that  the  new  entity  is  to 
associate  with.  For  example,  in  creating  an  employee,  one  of  the 
attributes  may  be  WORKS_IN  (DEPTNUM) ,  and  the  corresponding 
attribute  value  given  by  the  user  is  used  to  identify  the 
department  the  user  works  in.  However,  the  new  entity  cannot  be 
made  to  relate  to  a  non-existing  entity.  In  our  example,  if  the 
department  number  given  does  not  identify  an  existing  department 
entity,  the  employee  cannot  be  created. 

To  create  an  entity,  the  user  can  select  the  set  of  attribtes 
of  which  values  will  be  given.  That  is,  an  entity  may  be  created 
while  values  of  some  attributes  of  the  entity  are  not  known. 

The  system  will  also  intercept  values  of  attributes  that 
violate  the  attribute  definition.  This  includes  key  violation, 
value  type  violation  and  numeric  range  violation. 
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2.4.3  MODIFYING  ENTITIES 


Values  of  attributes  of  existing  entities  (i.e.,  entities  already 
created  using  the  CREATE  command  introduced  in  the  previous 
subsection)  may  be  modified.  To  do  so,  the  user  must  enter  the 
Modification  Subsession.  Modification  of  attributes  takes  3 
forms:  insert,  modify  and  delete.  However,  the  user  must  first 

identify  the  entity  to  be  modified  by  giving  value(s)  of  its 
attribute(s)  that  will  uniquely  identify  the  entity  in  the  entity 
set.  Then  he  will  specify  the  attributes  to  be  modified, 
prefixing  them  with  a  modification  operator  (i.e.,  insert,  modify 
or  delete).  At  the  prompt  for  data,  the  user  will  enter  new 
values  of  these  attributes.  The  following  is  an  example  of  a 
modify  command: 

EMPLOYEE 

-ID: EMPNUM , - INSERT : WORKS_I N ( DEPTNUM ) , -MODI FY : EMPADDR 

105,  14,  '550  Memorial  Drive' 

where  EMPLOYEE  in  the  first  line  specifies  the  entity  set  name, 
and  the  second  line  provides  the  information  about  what  to  be 
modified:  the  employee  entity  to  be  modified  is  identified  by 
employee  number  105,  the  attribute  of  this  employee  to  be 
inserted  is  a  derived  attribte  which  asserts  that  this  employee 
now  works  in  department  14,  and  this  employee's  address  is  to  be 
changed  to  '550  Memorial  Drive'. 
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Notice  that  the  interpretation  of  a  derived  attribute 
appearing  in  the  modify  command  is  the  same  as  that  in  the  create 
command;  that  is,  it  merely  associates  the  entity  being  modified 
to  an  existing  entity,  but  does  not  create  any  new  entities  or 
values.  An  error  message  will  be  given  if  the  associated  entity 
cannot  be  found  in  the  existing  data  base.  Also,  violation  of 
attribute  definition  will  cause  the  modify  command  to  be 
rejected. 


2.4.4  DELETING  ENTITIES 


To  delete  an  entity,  the  user  enters  into  the  Delete 
Subsession.  All  that  the  user  has  to  specify  is  a  set  of 
attributes  that  will  uniquely  identify  the  entity  to  be  deleted. 
All  other  attributes  of  this  entity  will  automatically  be 
removed.  An  example  is  given  below: 


EMPLOYEE 

EMPNUM 

105 


This  command  deletes  the  employee  entity  whose  number  is  105. 
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2 . 5  DATA  BASE  INTERNAL  SCHEMA 


The  data  base  internal  schema  describes  how  data  in  the  data 
base  is  actually  stored.  It  includes  aspects  such  as  access 
paths  and  record  formats.  This  section  provides  a  brief 
description  of  the  internal  schema  used  in  the  current  version  of 
FSTV,  which  is  implemented  at  the  Internal  Schema  Level  and  the 
Memory  Management  Level. 

The  internal  schema  used  in  FSTV  is  a  simple  network  type  of 
link  list.  Data  elements  are  grouped  into  Primitive  Sets 
(Psets).  For  each  primitive  set,  an  arbitray  number  of  Binary 
Associations  (Bsets)  can  be  defined.  When  a  data  element  is  to 
be  stored,  the  level  of  FSTV  above  the  Internal  Schema  Level 
identifies  the  Pset  this  data  element  belongs  to,  and  passes 
this  to  the  Internal  Schema  level  to  be  stored  in  that  Pset. 
Likewise,  the  data  elements  a  data  element  associates  with 
through  certain  Bsets  can  also  be  given,  and  later  can  be 
retrieved  together  with  that  data  element.  In  order  to  do  so,  the 
upper  level  will  have  to  define  Psets  and  Bsets  for  the  Internal 
Schema  Level,  and  remember  the  meaning  of  each  Pset  and  Bset . 
The  Internal  Schema  Level  will  provide  IDs  for  Psets  and  Bsets 
defined.  This  concept  of  BED  is  depicted  in  the  following 
figure . 
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NUM_PTR  ID_ARRAY  DLEN  DATA 
Figure:  An  example  BEU 


Pset  CITY  Pset  DEPT  Pset  DEPTNUM 

Figure:  An  example  BEU  network 
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The  way  the  internal  schema  level  organizes  these  data 
elements  is  through  linkage.  Each  data  element  is  implemented  as 
a  Basic  Encoding  Unit  (BEU) .  A  BEU  contains  the  data  and  some 
control  information.  In  the  current  version,  a  BEU  contains  an 
ID  array,  the  size  of  which  is  indicated  by  the  NUM_PTR  field  of 
a  BEU,  and  a  data  field,  the  size  of  which  is  indicated  by  the 
DLEN  field  of  a  BEU.  BEUs  of  one  Pset  are  chained  together 
through  a  bi-directional  link  list,  making  use  of  two  slots  in 
the  ID  array.  Association  with  other  data  elements  is 
implemented  by  storing  the  IDs  of  the  latter  in  pre-allocated 
slots  in  the  ID  array.  By  ’pre-allocated’  we  mean  that  the 
position  of  the  slot  determines  the  meaning  of  the  association, 
or  the  Bset  id.  Through  this  simple  mechanism,  data  elements 
and  their  associations  are  remembered  by  the  data  base. 

In  the  current  version,  there  are  no  special  access  paths 
built  for  the  purpose  of  improving  performance  of  a  search,  such 
as  indices  and  hash  tables.  There  is  also  no  intelligent  access 
path  selection  algorithm  to  identify  the  most  efficient  way  of 
locating  a  data  element  given  its  direct  or  derived  associations. 
While  these  capabilities  occupy  the  highest  priority  in  future 
refinement,  the  basic  functionalities  of  creating,  deleting, 
modifying  and  retrieving  data  elements  are  all  present. 

The  Memory  Management  Level  responds  to  the  Internal  Schema 
Level’s  requests  to  store  and  retrieve  BEU's.  When  a  BEU  is 
stored,  the  Memory  Management  Level  provides  an  id  which  can  be 
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used  as  a  key  for  retrieval  of  the  BEU.  This  level  currently 
manages  the  virtual  storage  by  linearly  assigning  BEU's  to  be 
stored  in  the  next  available  address.  No  segmentation  or 
clustering  is  provided  for. 


/ 
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3.0  IMPLEMENTATION  CHARACTERISTICS  OF  FSTV 


In  Chapter  2,  discussion  centered  around  the  capabilities  of 
the  FSTV  from  the  point  of  view  of  a  DBA  or  a  database  user.  In 
this  chapter  we  shall  describe  implementation  considerations 
which  characterize  FSTV  as  a  Software  Test  Vehicle  for  the 
Functional  Hierarchy  of  INFOPLEX.  The  content  of  this  chapter 
can  also  be  viewed  as  a  set  of  strategies  and  programming 
conventions  used  in  the  STV  project,  and  guidelines  to  be 
followed  in  future  software  modifications  and  additions.  The 
following  two  subsections  describe  implementation  characteristics 
relating  to  the  emulation  and  functional  decomposition  aspects, 
respectively,  of  FSTV. 


3.1  EMULATION  OF  A  MULTI-LEVEL  MPLTI -PROCESSOR  ARCHITECTURE 


As  mentioned  earlier  in  Chapter  1,  one  of  the  purposes  of  the 
STV  is  to  validate  proposed  algorithms  in  an  emulated  multi-level 
multi-processor  architecture  and  to  observe  their  behavior.  The 
Control  Structure  Subsystem  of  the  FSTV  is  devised  to  provide 


this  emulated  environment.  While  the  modules  in  the  FSTV  do  not 
have  to  be  aware  of  details  of  the  (emulated)  hardware 
environment,  its  program  structure  and  communications  between 
modules  must  conform  to  those  demanded  by  the  Control  Structure. 
The  Control  Structure,  on  the  other  hand,  will  provide  mechanisms 
for  multi-processing  and  global  bus  and  gateway  controller 
emulation  during  execution  of  the  FSTV  modules. 

Two  types  of  programming  conventions  are  observed  during 
implementation  of  FSTV  in  order  to  facilitate  working  with  the 
Control  Structure.  They  are  described  in  the  following 
subsections . 


3.1.1  SCOPE  AND  STORAGE  CLASS  OF  VARIABLES 

The  context  switching  mechanism  used  in  the  Control  Structure 
requires  that  the  static  and  the  controlled  variables  be  used 
with  caution.  (Refer  to  chapter  7  of  <To81>.)  In  essence,  the 
FSTV  program  modules  should  make  use  of  the  based  and  automatic 
varialbes  and  refrain  from  using  the  static  and  controlled 
variables  as  much  as  possible.  In  the  current  implementation  of 
the  FSTV,  static  variables  are  used  in  association  with  the 
initialization  modules  only;  i.e.,  once  the  FSTV  is  initialized, 
values  of  these  variables  will  stay  constant  during  run  time. 


The  controlled  variables  are  not  used  in  any  module.  By 
observing  this  rule,  the  FSTV  modules  are  made  re-entrant,  therby 
making  it  a  relatively  simple  task  to  generate  the  multi-threaded 
version  of  the  FSTV. 

In  addition,  the  architectural  requirement  that  there  be  no 
shared  data  across  levels  necessarily  limits  the  scope  of  the 
variables  to  being  within  the  modules  of  the  same  level  only. 
External  variables  known  to  modules  across  levels  should  not  be 
used.  A  simple  rule  to  follow  therefore  is  to  avoid  using 
external  variables.  In  the  current  implementaton ,  use  of  the 
external  variables  are  associated  with  the  initialization 
variables  mentioned  in  the  previous  paragraph,  and  none  are  known 
across  levels.  Appendix  2  contains  a  list  of  all  external  and/or 
static  variables  used  in  the  current  version. 


3.1.2  INTER-LEVEL  COMMUNICATION 

The  hierarchical  structure  of  INFOPLEX  requires  that 
inter-level  procedure  calls  go  through  gateway  controllers  and 
the  global  bus.  In  simulating  this  architecture,  the  Control 
Structure  Subsystem  of  the  STV  assumes  that  the  functional 
modules  observe  the  inter-level  procedure  call  convention. 
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Inter-level  communications  in  the  FSTV  are  in  the  form  of 
message  passing  between  adjacent  levels.  Direct  communication 
between  unadjacent  levels  is  not  used. 

Message  passing  vs.  subroutine  call.  Each  level  of  INFOPLEX 
contains  a  number  of  functional  modules.  In  the  STV,  they  are 
represented  by  program  modules.  Normally,  when  a  module 
encounters  a  sub-task  which  is  to  be  processed  by  another  module, 
it  uses  a  subroutine  to  activate  the  latter.  However,  since  the 
FSTV  is  constructed  for  use  in  a  multi-level  multi-processor 
system,  a  number  of  pre-defined  tasks  are  not  invoked  directly, 
but  are  invoked  through  message  passing,  a  facility  which  is 
provided  by  the  Control  Structure.  In  fact,  all  cross-level 
invocations  are  done  through  message  passing.  This  conforms  to 
the  requirement  of  the  architecture  as  well  as  to  the  need  of 
informing  the  Control  Structure  in  the  event  of  an  inter-level 
call,  so  that  the  Control  Structure  can  emulate  the  load  on  the 
gateway  controller  and  the  global  bus. 

The  Control  Structure  provides  a  set  of  message  passing 
protocols  (including  message  passing  among  modules  in  the  same 
level.)  (Refer  to  chapter  5  and  7  of  <To81>.)  When  a  module  at 
a  higher  level  in  the  Functional  Hierarchy  needs  to  invoke  a 
module  at  a  lower  level,  it  necessarily  makes  use  of  these 
protocols  in  place  of  a  direct  subroutine  call.  Likewise,  when 
the  module  at  the  lower  level  completes  the  task,  it  makes  use  of 
these  protocols  to  send  the  results  back  to  the  invoking  module. 
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To  this  end,  all  modules  in  the  FSTV  are  divided  into  two 
groups:  the  Top-Level  Procedures  (T-proc's)  and  the  Subroutine 
Procedures  (S-proc's).  The  T-proc's  are  always  invoiced  by 
message  passing,  and  the  S-proc's  by  direct  subroutine  calls. 
Each  level  is  consisted  of  a  set  of  T-proc's  which  can  be  invoked 
by  the  upper  level,  and  a  set  of  S-proc's  whose  names  are  unknown 
to  any  other  levels,  and  are  not  directly  invocable  by  the  upper 
level.  It  is  noted  that  to  invoke  a  T-proc  at  the  same  level  a 
process  will  have  to  send  a  message  to  it  rather  than  to  use  a 
traditional  subroutine  call.  Therefore  the  convention  for 
inter-level  procedure  call  is  more  properly  termed  as  the 
convention  for  inter-T-proc  call. 

Since  T-proc's  represent  entry  points  to  a  level,  special 
attention  is  given  to  its  invocation.  The  arguments  needed  to 
invoke  a  T-proc  are  grouped  into  a  set  of  Control  Blocks.  A 
control  block  is  a  based  variable  which  cntains  a  pre-defined 
data  structure.  The  set  of  control  blocks  associated  with  a 
T-proc  includes  both  the  calling  control  blocks  and  the  return 
control  blocks.  When  the  T-proc  is  invoked,  it  is  passed  a  link 
list  of  calling  control  blocks;  when  it  returns,  it  puts  the 
return  messages  and  values  in  a  link  list  of  return  control 
blocks.  The  names  of  the  T-proc's  at  a  level  and  the  control 
blocks  associated  with  them  collectively  form  the  interface  of 
the  level  seen  by  the  upper  level.  This  mechanism  satisfies  the 
requirement  that  "..each  level  of  the  functional  hierarchy 
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interacts  with  other  levels  through  a  clean  set  of  interfaces 
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<Hsu80>.  Messages  passed  between  levels  are,  therefore,  link 
lists  of  control  blocks.  Details  of  control  block  formatting 
conventions  are  described  in  the  following. 

Control  Slock  Format.  According  to  the  hardware  architecture 
of  INFOPLEX  which  requires  that  no  shared  memory  is  used  between 
levels,  when  a  message  is  to  be  passed  to  a  process  at  another 
level  the  message  is  to  be  physically  moved  from  the  local  memory 
of  the  calling  level  to  that  of  the  called  level.  In  simulating 
this  activity,  the  Control  Structure  has  to  be  given  a  pointer 
to  the  message  and  the  length  of  the  message.  While  it  is 
possible  to  give  the  Control  Structure  a  message  in  a  contiguous 
block,  it  is  more  desirable  from  the  programmers'  point  of  view 
to  be  able  to  give  the  Control  Structure  a  link  list  and  the 
necessary  information  for  the  Control  Structure  to  collect  all 
data  in  the  link  list.  To  this  purpose,  a  convention  for 
interacting  with  the  Control  Structure  is  devised:  every  element 
(a  Control  Block)  of  the  link  list  contains  a  CNTL_INFO  as  the 
first  field  of  the  data  structure  as  follows: 

2  CNTL_INFO, 

3  LEN  FIXED  BIN  (15) , 

3  CBTP  FIXED  BIN  (15) , 

3  PTR  PTR , 

2  DATA, 
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where  LEN  describes  the  length  of  the  data  portion  of  the  control 
block,  CBTP  is  a  unique  number  assigned  to  this  type  of  control 
block,  and  PTR  points  to  the  next  control  block  in  the  link  list. 
With  the  information  in  CNTL_INFO  the  Control  Structure  will  be 
able  to  collect  all  elements  and  move  them  to  the  other  level. 
Similary,  the  called  process  simply  follows  the  pointers  to 
obtain  all  arguments  it  needs.  The  data  structure  of  the  DATA 
portion  of  a  control  block  list  represents  the  agreed  upon 
interface  between  sending  and  receiving  processes.  This 
convention  aplies  to  both  argument  passing  and  return  data. 
Examples  of  Control  Blocks  are  given  in  Appendix  2. 

I 

I 

!  Service  routines  and  programming  conventions.  In  order  to 

I  insulate  the  FSTV  modules  from  furture  changes  to  the  Control 

Structure-provided  communication  protocols,  a  set  of  service 
routines  are  used  to  centralize  the  use  of  these  protocols. 
These  are  SVCS1  and  SVCS2.  In  adiition,  since  the  current 
version  of  FSTV  does  not  make  use  of  intra-request  parallelism, 
another  set  of  service  routines  are  devised  on  top  of  SVCS1  and 
SVCS2  in  such  a  way  that,  if  these  routines  are  used  to  invoke 
i  protocols  provided  by  the  Control  Structure,  the  existence  of  the 

Control  Structure  could  be  completely  shielded  from  the  FSTV. 
Therefore,  for  example,  it  is  possible  to  run  FSTV  alone  without 
the  Control  Structure,  so  long  as  the  second  set  of  service 
routines  is  replaced  by  a  dummy  set.  This  feature  enables 


independent  debugging  and  testing  of  the  FSTV  from  the  Control 
Structure,  thereby  reducing  the  complexity  of  the  software 
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development  process.  The  next  chapter  contains  a  description  of 
these  service  routines,  their  interfaces  and  how  to  use  them. 


3.2  FUNCTIONAL  DECOMPOSITION 


The  database  management  functions  in  the  current  version  of 
the  FSTV  have  been  hierarchically  decomposed  into  four  levels. 
Each  level  communicates  with  only  the  adjacent  level.  The 
following  figure  illustrates  the  relationship  between  the  current 
implementation  and  the  target  implementation  as  outlined  in 
<Hsu80>.  While  the  current  implementation  is  a  simplified 
version  of  the  target  system,  it  illustrates  the  process  of 
reducing  a  reasonably  complicated  user  query  to  accesses/updates 
in  a  linear  address  space. 


STORAGE  HIERARCHY 


I 
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One  important  'feature'  of  the  design  is  to  be  stressed.  To 
eliminate  duplication  of  data  storage  and  its  management 
functions,  system  databases  (e.g.,  catalogues)  used  at  a  level 
are  stored  and  manipulated  as  regular  data  at  the  next  level. 
That  is,  all  the  catalogues  used  at  a  level  are  defined  as  data 
sets  at  the  next  lower  level  during  the  initialization  process. 
This  means  that  the  local  memory  at  a  level  is  strictly  used  for 
storing  the  context  of  active  processes,  and  that  all  the 
structuring  information  such  as  catalogues  and  indices  as  well  as 
the  database  itself  is  stored  in  the  virtual  memory  (therefore  in 
the  Storage  Hierarchy)  managed  by  the  Memory  Management  Level. 

The  four  levels  in  the  current  implementation  are  briefly 
described  as  follows.  Details  of  the  functional  modules  are  the 
subject  of  chapter  5. 

1.  User  Interface  Level  (Level  1):  This  level  interacts 
with  the  user  directly.  It  accepts  users’  commands  to 
define  and  manipulate  the  databases.  It  parses  input 
character  strings,  identifies  the  meaning  of  the  input 
tokens,  and  generate  proper  requests  to  the  next  level  for 
validation  and  execution  of  the  input  commands.  For  ease  of 
use,  the  data  definition  portion  of  the  user  interface  makes 
use  of  the  panel  facility,  which  enables  the  DBA  to  define 
the  database  by  filling  up  blanks  in  a  pre-defined  panel. 
This  level  does  not  create  or  make  use  of  any  system 
databases . 
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2.  Database  Semantics  Level  (Level  2,  or  The  Entity  Level): 
This  level  manages  the  entity/attribute  catalogues, 
validates  database  insertions  and  updates,  and  transforms 
the  high  level  database  definition  and  manipulation  requests 
into  commands  to  operate  on  the  data  structures  of  the 
internal  schema.  The  system  database  at  this  level,  the 
entity/attribute  catalogues,  is  itself  defined  in  terms  of 
entities  and  attributes,  and  is  stored  as  regurlar  database 
data  in  the  next  level. 

3.  Internal  Schema  Level  (Level  3,  or  The  N-ary  Level): 
This  level  manages  the  Pset/Bset  catalogues  and  performs 
retrieval  and  update  of  the  content  'of  the  pre-defined  Psets 
and  Bsets.  It  accepts  a  tree-structured  database  command 
and  decides  upon  the  P-elements  to  be  retrieved  or  affected 
and  executes  the  command.  It  ultimately  implements 
information  in  the  database  in  the  form  of  BEU’s  (3asic 
Encoding  Units);  a  BEU  is  given  to  the  next  lower  level  to 
be  stored  as  a  unit  of  bit  string.  The  internal  schema 
implemented  in  the  current  version  is  very  simple:  it 
implements  P-elements  within  the  same  Pset  as  an  unsorted 
bi-directional  link  list,  and  binary  associations  among  the 
P-elements  through  uni-directional  linkage  pointers. 

4.  Memory  Management  Level  (Level  4):  This  level  manages  a 
linear  virtual  address  space  which  is  initialized  by  the 
FSTV  Console  Program  as  a  based  area  of  a  certain  size. 
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Store,  retrieval  and  update  of  BEU's  are  carried  out  at  this 
level  as  operations  on  this  based  area. 
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4 . 0  FSTV  INTER-LEVEL  COMMUNICATION  SERVICE  ROUTINES 


This  chapter  documents  the  set  of  service  routines  used  by 
FSTV  functional  programs  to  interface  with,  and  to  insulate  from, 
the  Control  Structure-provided  message  passing  protocols.  The 
first  section  describes  the  two  service  routines,  SVCS1  and 
SVCS2,  which  are  used  by  FSTV  functional  modules  to  insulate 
themselves  from  directly  using  the  SEND  protocol  provided  by  the 
Controld  Structure.  The  second  section  describes  another  set  of 
service  routines,  TCALL,  TBEG  and  TRTN,  which  are  used  to 
insulate  the  FSTV  completely  from  the  Control  Structure. 


4.1  INSULATING  FROM  SEND  PROTOCAL  —  USE  OF  SVCS1  AND  SVCS2 


Convention  for  the  calling  procedure.  When  a  process  wishes 
to  invoke  a  T-proc,  it  must  send  a  message  to  the  operating 
system  of  the  target  level.  The  message  will  contain  the  name  of 
the  procedure  to  be  invoked  and  a  pointer  to  a  message  to  the 
invoked  procedure.  The  latter  message  contains  the  return  address 
(e.g.,  the  mail  box  number)  and  calling  arguments  if  any. 


The  calling  process  will  prepare  the  calling  arguments  as  a 
link  list  of  control  blocks.  (The  meaning  and  the  format  of  a 
control  block  has  been  described  in  the  previous  chapter.)  This 
link  list  is  called  a  calling  control  block  link  list.  The 
calling  control  block  link  list  will  then  be  prefixed  with  a 
special  control  block,  the  MSG  control  block.  The  purpose  of 
this  MSG  control  block  is  to  inform  the  invoked  procedure  of  the 
process  id  (i.e.,  the  process  address)  of  the  calling  process,  so 
that  return  messages  shall  be  routed  correctly.  The  format  of 
this  MSG  control  block  is  exemplified  by  the  following 
declaration: 

DCL  1  MSG  BASED  (P), 

2  CNTL_INFO, 

3  LEN  FIXED  BIN  (15)  INIT(6), 

/*  LENGTH  OF  DATA  PORTION  */ 

3  DUM_CBTP  FIXED  BIN,  /*  NOT  USED  */ 

3  PTR  PTR, 

/*  POINT  TO  FIRST  CONTRO  BLOCK  IN  CALLING 
ARGUMENT  LINK  LIST  */ 

2  DATA, 

3  PROC_ADDR , 

/*  ADDRESS  OF  THE  PROCESS  INITIATING 
THIS  MESSAGE  */ 

(4  LEVEL, 

4  VPID, 

4  BOXID)  FIXED  BIN  (15); 
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The  entire  message  link  list  is  sent  by  calling  SVCS1  service 
routine.  SVCS1  takes  2  arguments:  the  name  of  the  procedure  to 
be  invoked  (CHAR(8))  and  a  pointer  to  the  message  link  list 
{ PTR ) .  It  does  not  care  about  the  content  of  the  message  link 
list.  SVCS1  returns  a  return  code  (FIXED  BIN(15)): 

CALL  SVCS1  (PROC_NAME,PTR,RTN_CODE) ,* 

After  the  call,  the  calling  process  may  continue  until  the  point 
at  which  a  return  message  from  the  call  is  needed.  It  then  calls 
the  WAIT  protocol  provided  by  the  Control  Structure,  specifying 
the  mailbox  it  waits  on: 

CALL  WAIT  ( BOXID) ; 

after  which  it  may  obtain  the  return  message  by  moving  the 
relevant  data  pointed  to  by  VP. WAIT. MSG  (set  by  the  Control 
Structure)  to  the  appropriate  variables. 

A  calling  process  may  send  multiple  messages  at  the  same  time, 
thereby  achieving  the  benefit  of  intra-request  parallelism. 

Convention  for  the  called  procedure.  All  T-proc  processes 
will  have  to  respond  to  the  message  passing  protocols  set  up  by 
the  Control  Structure.  When  it  is  created,  it  must  first  locate 
the  message  link  list  passed  to  it  from  the  caller  in  the  base 
variable  pointed  to  by  VP. WAIT. MSG.  Before  it  finishes,  it  must 
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have  sent  the  return  message,  if  any,  to  the  calling  process. 
The  format  of  the  message  passed  to  it  is  as  described  in  the 
previous  subsection.  To  send  a  return  message  to  an  existing 
process,  however,  SVCS2  is  used.  SVCS2  also  takes  2  arguments: 
the  address  of  the  receiving  process  (LEVEL, VPID, BOXID)  and  a 
pointer  to  the  return  message  link  list:  (The  return  message 
link  list  is  constructed  in  a  way  similar  to  that  of  the  calling 
message;  i.e.,  a  return  control  block  link  list  prefixed  with  a 
MSG  control  block.) 

CALL  SVCS  2  ( PROC_ADDR , P , RTN_CODE ) ; 

Note  that  it  is  possible  for  2  processes  to  engage  in  a 
conversation,  in  the  sense  that  the  calling  process  may  send  a 
second  message  to  the  called  process  after  the  calling  process 
has  already  obtained  some  return  message  from  it.  That  is  to 
say,  a  called  process  needs  not  "finish"  itself  immediately  after 
sending  the  return  message. 

Summary.  The  functional  program  modules  accomplish 
inter-T-procedure  calls  through  SVCS1  and  SVCS2  service  routines. 
SVCS1  is  used  to  invoke  a  new  process,  while  SVCS2  is  used  to 
send  (return)  messages  to  a  known  process.  Both  SVCS1  and  SVCS 2 
take  two  arguments:  the  name  of  the  procedure  to  be  invoked  or 
the  address  of  the  existing  process  the  message  should  go  to,  and 
a  pointer  to  the  message  link  list. 


k 
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Text  inclusion,  A  module  which  wishes  to  use  SVCS1  and  SVCS2 
should  include  the  macro  SVCS.  Declarations  of  MSG,  PROC_ADDR, 
PROC_NAME  are  provided  for  in  the  macro. 


4.2  INSULATING  FROM  CONTROL  STRUCTURE  ~~  ADDITIONAL  SERVICE 
ROUTINES 


To  avoid  direct  use  of  WAIT  and  FINISH  protocols  and 
VP. WAIT. MSG  provided  by  the  Control  Structure  as  well  as  SVCS1 
and  SVCS2 ,  a  functional  module  may  use  a  set  of  3  service 
routines  to  accomplish  inter-T~proc  commun icat i on :  TBEG ,  TRTN 
and  TCALL . 

Convention  for  the  called  T-proc.  When  a  T-proc  process  is 
first  invoked,  it  calls  TBEG  to  obtain  the  return  address  ( i .  e .  , 
the  process  address  of  the  calling  process.)  The  call  takes  the 
following  form: 

CALL  TBEG.  ( PROC_ADDR , P ) ; 

where  PROC_ADDR  will  be  loaded  with  the  identifier  of  the 
calling  process,  and  P  points  to  the  first  control  block  in  the 
argument  link  list. 
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Note  that  the  MSG  control  block  described  in  the  previous  section 
stripped  off  by  TBEG  and  no  longer  concerns  the  functional 
module .  When  a  T-proc  returns,  it  calls  TRTN  to  pass  the  return 
control  block  link  list  to  the  calling  process.  The  call  takes 
the  following  form: 

CALL  TRTN  ( PROC_ADDR ,  P )  ; 

where  PROC_ADDR  is  as  described  above  and  P  points  to  the  first 
control  block  in  the  return  control  block  link  list.  Note  also 
that  the  user  of  TRTN  no  longer  needs  to  prefix  its  return  link 
list  with  the  MSG  control  block,  since  the  latter  will  be  added 
to  by  the  TRTN  routine. 

Convention  for  the  calling  T-proc.  when  a  module  wishes  to 
invoke  T-proc,  it  formats  the  arguments  in  the  form  of  a  control 
block  link  list,  and  then  issues  the  following  call: 

CALL  TCALL  ( PROC_NAME , BOXI D , ARG_PTR , RTN_PTR ) ; 

where  PROC_NAME  is  the  name  of  the  T-proc  to  be  invoked,  BOXID  is 
the  mailbox  number  where  the  caller  wishes  the  return  messages  to 
be  stored,  ARG_PTR  points  to  the  first  control  block  in  the 
argument  control  link  list,  and  RTN_PTR  (a  return  value)  will 
point  to  the  first  control  block  of  the  return  control  block  link 
list. 
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NOTES : 

1.  This  set  of  service  routines  can  not  be  used  to  engage 
two  communicating  processes  in  a  "conversation  mode"  (refer 
to  section  2),  nor  can  it  be  used  when  there  is 
intra-request  parallelism  involved. 

2.  To  use  this  set  of  routines,  the  SERVICE  macro  must  be 


included. 
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5.0  OVERVIEW  OF  FSTV  FUNCTIONAL  PROGRAM  MODULES 


This  chapter  contains  a  description  of  the  logical  function 
and  the  data  structure  of  program  modules  in  the  current  version 
of  FSTV.  The  description  follows  the  four  hierarchical  levels 
employed  in  FSTV,  starting  from  the  bottom  level.  For  each 
level,  we  will  discuss  the  data  model  (i.e.  the  data  structure  of 
objects  processed  at  the  level)  and  the  system  databases  used, 
and  provide  an  overview  of  the  data  definition,  data 
manipulation,  and  level  initialization  modules  that  make  up  the 
level.  The  reader  will  notice  that  modules  at  a  level  are 
classified  into  T-proc's  and  S-proc's  as  discussed  in  the 
previous  chapters,  and  that  conventions  and  constraints  mentioned 
previously  are  observed.  In  addition,  the  reader  will  see  how 
information  abstraction  proceeds  from  the  bottom  level  which 
recognizes  only  a  linear  virtual  address  space  used  as  the 
database  store  to  the  database  semantics  level  which  processes 
high  level  constructs  such  as  entities  and  attributes.  A 
complete  listing  of  these  program  modules  is  included  in  Appendix 
3.  The  following  figure  contains  a  diagram  showing  all  modules 
in  the  current  implementation. 
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System  Initialization. 


Functional  Hierarchy  initialization  consists  of  activities 
which  render  the  functional  modules  in  a  runnable  condition. 
Presently  an  assumption  is  made  of  the  initial  condition  of  the 
system  when  it  is  'powered  on’:  each  level  will  already  have  all 
the  functional  modules  loaded  into  its  local  memory.  This  may 
not  be  the  case  in  reality.  A  bootstrap  procedure  which  loads 
the  minimum  set  of  the  functional  modules  (the  core  set)  from  the 
Storage  Hierarchy  may  have  to  be  added  to  each  level.  However, 
for  the  purpose  of  this  first  version,  we  may  assume  that  this 
type  of  bootstrap  is  taken  care  of  by  the  local  operating  system, 
which  is  simulated  as  part  of  the  Control  Structure  and  is  out  of 
the  scope  of  FSTV. 

Initialization  of  catalogues  is  also  necessary  before  the 
system  can  respond  to  normal  processing.  For  a  system  without  an 
existing  database  (i.e.,  an  INFOPLEX  just  bought  off  the  shelf), 
the  initialization  module  at  a  level  will  define  the  catalogue 
structures  used  at  the  level  in  terms  of  data  sets  implemented  at 
the  next  lower  level  and  establish  a  set  of  ’key’  values  which 
will  be  used  at  this  level  when  normal  processing  starts.  This 
means  that  initialization  ought  to  start  from  the  bottom  level. 


To  initialize 

a  system  which  already 

has  a 

database , 

the 

catalogue  definition 

activities  are 

omitted,  and 

the 

initialization 

module 

simply  restores 

the  key 

values . 

The 
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individual  initialization  modules  will  be  discussed  further  in 
the  following  subsections. 


5.1  MEMORY  MANAGEMENT  LEVEL 

The  function  of  this  level  is  to  manage  the  virtual  memory 
address  space  that  Functional  Hierarchy  is  provided  for  by 
Storage  Hierarchy  and  to  interface  with  Storage  Hierarchy. 


5.1.1  DATA  MODEL  AT  THE  MEMORY  MANAGEMENT  LEVEL 

The  basic  element  stored  in  SH  is  the  Storage  Encoding  Unit 
(SEU).  Each  stored  SEU  is  assigned  a  SEU  id,  which  is  equivalent 
to  the  virtual  address  of  this  stored  SEU  in  the  Storage 
Hierarchy.  An  SEU  has  the  following  format: 

DCL  1  SEU  BASED  (SEUPTR) 

/*  2  MOVE_PTR  BIT( 32 ) ,  NOT  USED  CURRENTLY  */ 


2  N  FIXED  BIN, 

2  INVAL  CHAR ( 1 )  INIT('N'), 

2  DATA  CHAR ( I  REFER  { SEU . N ) ) ; 
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where  MOVE_PTR  is  an  id  in  the  SH  which  is  always  null  unless  the 
SEU  has  been  moved,  in  which  case  MOVE_PTR  contains  the  new 
location  in  SH,  INVAL  is  a  flag  which,  when  set,  signifies  that 
this  SEU  has  been  deleted,  and  finally  DATA  is  a  character  string 
with  a  variable  length  indicated  by  N  and  contains  the  data  of 
this  SEU. 

The  format  of  SEU  is  known  to  modules  within  this  level  only. 
The  level  above  will  pass  to  this  level  a  bit  string  of  data  to 
be  stored  as  a  unit  in  return  for  an  id,  and  retrieve  this  bit 
string  back  by  presenting  to  this  level  the  id.  The  Memory 
Management  Level  will  allocate  a  SEU  for  each  unit  of  data  to  be 
stored,  and  put  the  data  in  the  DATA  field  of  the  SEU.  It  then 
finds  a  free  area  in  the  virtual  memory  and  passes  the  SEU  to  the 
Storage  Hierarchy. 


5.1.2  SYSTEM  DATABASES  AND  DATA  DEFINITION  MODULES  AT  THE  MEMORY 
MANAGEMENT  LEVEL 


Presently  a  very  simple  memory  management  function  is 
provided.  Storage  in  the  virtual  memory  is  assigned 
incrementally  starting  from  address  16.  Therefore  the  only 
"system  database"  needed  is  a  counter  indicating  the  next 
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available  virtual  address.  This  counter  is  stored  in  address  0  of 
the  Storage  Hierarchy. 

No  data  dictionary  is  used  in  the  current  version.  There  is 
also  no  data  definition  necessary. 


5.1.3  DATA  MANIPULATION  MODULES  AT  THE  MM  LEVEL 


There  are  four  T-proc  modules  at  this  level  to  perform 
creation,  deletion,  modification  and  retrieval  of  data  elements. 
Each  of  these  functions  is  performed  by  one  module. 

CRT.  This  module  responds  to  requests  from  the  upper  level  to 
store  data  elements.  Its  calling  control  block  contains  the  data 
and  the  length,  while  the  return  control  block  contains  an  ID, 
which  is  the  bit  representation  of  the  virtual  address  assigned 
to  the  SEU  encompassing  the  data.  This  module  calls  subroutine 
GMEM  to  get  the  virtual  address,  and  subroutine  PSEU  to  decompose 
the  SEU  into  8-byte  packets  and  to  store  them  into  the  Storage 
Hierarchy, 


RET.  This  module  processes  requests  to  retrieve  a  data 


elements  given  its  id.  It  calls  subroutine  GSEU  to  retrieve  the 
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SEU  of  the  data  element  from  SH  using  the  id  and  extracts  the 
DATA  portion  of  the  SEU  to  return  to  the  upper  level. 

MOD.  This  module  processes  requests  to  modify  content  of  a 
data  element  given  its  id  and  new  data.  Like  RET,  it  calls  GSEU 
to  retrieve  the  SEU  of  the  data  element  from  SH  and  replaces  the 
DATA  field  of  the  SEU  with  the  new  data,  and  calls  PSEU  to  put  it 
back  into  SH. 

DEL.  This  module  processes  requests  to  delete  a  data  element 
given  its  id.  It  calls  GSEU  to  retrieve  the  SEU,  sets  its  INVAL 
field,  and  calls  PSEU  to  put  it  back.  No  garbage  collection  is 
performed  in  the  present  implementation. 


5.1.4  INITIALIZATION  AT  THE  MEMORY  MANAGEMENT  LEVEL 


MINIT.  This  module  performs  all  the  necessary  steps  to 
initialize  this  level  during  IPL.  The  calling  control  block 
contains  the  method  of  initialization  ('file'  or  'new').  If  it 
initializes  from  a  Storage  Hierarchy  that  doesn't  contain  any 
data  yet  (i.e.,  a  'new'  initialization),  it  bootstrap  a  value 
'16'  into  the  first  word  of  the  Storage  Hierarchy,  which  is  to  be 
used  as  a  register  for  the  next  availabe  address.  If  it 
initializes  from  an  existing  database,  it  retrieves  a  one-word 


'key*  for  the  upper  level  from  a  fixed  location  in  SH  and 
includes  it  in  the  return  control  block.  (The  upper  level  will 
use  this  key  to  ’recover'  its  system  databases.)  This  module 
also  provides  an  interface  (i.e.,  when  the  OP  field  of  the 
calling  control  block  contains  ’S’)  for  the  upper  level  to  store 
a  key. 


5.1.5  SUBROUTINES  AT  THE  MEMORY  MANAGEMENT  LEVEL 

There  are  4  subroutines  at  this  level.  GMEM  (Get  MEMory) 
returns  a  virtual  address  of  a  free  area  in  SH  given  the  length 
of  the  area  requested.  PSEU  (Put  SEU)  decomposes  a  given  SEU 
into  8-byte  packets  and  stores  them  consecutively  into  a  given 
area  in  SH.  GSEU  (Get  SEU)  performs  the  reverse  of  the  task  of 
PSEU:  given  an  address  of  an  area,  reconstruct  the  SEU  contained 
in  that  area  by  retrieving  a  packet  at  a  time  from  SH.  And, 
finally,  PART  (PAcKeTing)  is  a  subroutine  called  by  the  above  3 
subroutines  to  get  a  packet  of  data  from  SH  given  its  byte 
address.  PART  is  the  only  routione  in  the  FSTV  which  is  aware  of 
the  interface  to  the  top  level  of  SH.  The  interface  is  declared 
as  a  data  structure  ARG. 
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5.2  INTERNAL  SCHEMA  LEVEL 


This  level 
database.  It 
relationships , 
data . 


provides  various  ’stored  structures'  to  store  the 
accepts  definitions  of  data  element  sets  and  their 
and  performs  search,  retrieval  and  update  of  these 


5.2.1  DATA  STRUCTURES  AT  THE  INTERNAL  SCHEMA  LEVEL 


This  level  envisions  that  the  world  is  composed  of  a  network 
of  some  basic  data  elements  called  Primitive  elements 
(P-elements . )  P-elements  and  their  relationships  are  implemented 
at  this  level  in  the  form  of  a  Basic  Encoding  Unit  (BEU) .  The 

reader  is  referred  to  section  2.5  for  a  description  of  the  BEU 

I 

concept  employed  in  this  implementation.  A  BEU  is  declared  as 
|  ^  follows: 

f 

! 

/*DCL  OF  BASIC  ENCODING  UNIT  (BEU)  USED  IN  THE  N-ARY  LEVEL***/ 

DCL  1  BEU  BASED (P), 

2  NUMPTR  FIXED  BIN, 

2  ID_ARRAY ( I  REFER  ( BEU. NUMPTR) ) BIT( 32 )  INIT  ( ( I )UNSPEC (NULL) ) 
2  DLEN  FIXED  BIN, 

2  DATA  BIT( J  REFER  ( BEU . DLEN ) ) ; 
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where  ID^ARRAY  is  an  array  of  ID's  of  related  BEUs' .  NUMPTR 
indicates  the  number  of  slots  its  ID_ARRAY  contains,  DATA  is  the 
bit  string  of  the  data  element,  and  DLEN  indicates  the  length  of 
the  data  in  terms  of  number  of  bits. 

The  format  of  the  BEU  is  known  only  to  this  level.  The  upper 
level  is  not  aware  of  how  PSETs  and  their  inter-relationships  are 
stored. 


5.2.2  SYSTEM  DATABASES  AND  DATA  DEFINITION  AT  INTERNAL  SCHEMA 
LEVEL 


Definition  of  Psets  and  Bsets  are  kept  in  two  catalogues:  the 
Primitive  Set  Cataluge  (PCAT)  and  the  Binary  Association  Set 
Catalogue  ( BCAT) .  Each  entry  in  PCAT  describes  a  primitive  set. 
Its  format  is  described  by  the  following  declaration; 

/*DCLS  OF  PSET  CATALOGUE  AT  THE  N-ARY  LEVEL******/ 

DCL  1  PINFO, 

3  NUMPTR  FIXED  BIN, 

3  PLEN  /*IN  NUMBER  OF  BYTES*/  FIXED  BIN, 

3  PTYPE  CHAR  (1),  /*’N'  OR'X'  OR  'B'  OR  'C'*/ 

3  LTYPE  BIT  (8),  /*’ 00000001'  IS  LINK  LIST*/ 


3  L_ID  BIT  (32),  /*ID  OF  THE  FIRST  BEU  IN  THIS  SET**/ 

3  LJPOS  FIXED  BIN  ,  /*POS  IN  ID_ARRY  USED  FOR  LINEAR  CHAINING 
OF  BEU'S  WITHIN  THIS  SET*/ 

3  L_POS2  FIXED  BIN, 

3  MAP  BIT  (32)  ;  /*UP  TO  16  PTRS  ARE  ALLOWED  FOR  A  BEU*/ 

where  NUMPTR  describes  the  size  of  the  I D_ARRA Y  of  the  BEU’s  in 
this  Pset;  PLEN  is  the  legnth  of  the  data  element;  PTYPE 
describes  the  data  type  of  this  primitive  set,  which  can  be 
numeric,  bit  or  character  string;  PTYPE  'X'  is  a  special  type 
which  is  used  when  the  data  value  of  the  Pset  in  question  is 
insignificant  (in  this  case  the  Pset  is  mainly  used  as  an  anchor 
for  binary  associations);  L_POS  and  L_POS2  are  the  I D_ARRA Y  slots 
used  for  forward  and  backward  chaining  of  all  BEU's  in  the  Pset; 

MAP  is  used  to  record  assignment  of  ID_ARRAY  slots:  if  the  n-th 
slot  is  assigned,  the  n-th  bit  in  MAP  will  be  set;  LTYPE 
describes  how  BEU's  in  this  Pset  are  grouped  together:  currently 
only  the  bi-directional  link  list  is  in  use.  Among  these 
parameters,  NUMPTR,  PLEN  and  PTYPE  are  provided  by  the  upper 
level  (refer  to  the  description  of  DEFP  below),  while  the  rest 
are  internally  generated. 

Each  entry  in  BCAT  describes  a  binary  association  set.  Its 
format  is  described  by  the  declaration  of  BCAT: 

/*DCL  OF  BCAT  TEMPLATE*/ 

DCL  1  BINFO, 


1. 


¥ 
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! 
i 

j 

2  PSETID(2)  BIT  (32)  , 

2  POS  FIXED  BIN,  /*POS  OF  POINTER  ARRAY  OF  PSETID1  USED  */ 
2  FUNC  CHAR  (1);  /*'S'  OR  ' M*  */; 

where  PSETID(l)  and  PSETID(2)  contain  the  ID's  of  the  source  Pset 
and  the  targe  Pset  involved  in  this  binary  association  (note  that 
all  binary  associations  are  directional);  POS  conatins  the 
ID_ARRAY  slot  number  used  by  BEU' s  in  the  source  Pset  to  record 
the  ID's  of  the  associated  BEU's  in  the  target  Pset;  FUNC 
indicates  the  type  of  relationship  between  the  source  and  the 
target:  one-to-one  (’S')  or  many-to-one  ('M'). 

Both  PCAT  and  BCAT  are  themselves  implemented  as  Psets. 
Therefore  each  catalogue  entry  is  implemented  as  a  BEU.  These  two 
Psets  are  defined  during  system  initialization  (refer  to  section 
5.2.4),  creating  the  very  first  two  PCAT  entries  of  the  system. 
This  is  exemplified  by  the  following  figure. 
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Figure:  Structure  of  the  Catalogue  Implementation  at  the 
Internal  Schema  Level  (N-ary  Level) 


To  remember  the  ID's  of  the  two  BEU's  that  implement  these  two 
catalogue  entries,  two  static  variables  are  given  values  to 
during  initialization:  PCATID  and  BCATID.  Their  values  will 
remain  constant  for  the  rest  of  the  system  processing. 
Procedures  for  defining  Psets  and  Bsets  will  reference  these  two 
variables  in  order  to  insert  new  entries  into  the  catalogue  entry 
chain . 

Two  T-proc's  form  the  data  definition  interface  of  this  level. 
They  are  described  below: 

DEFP.  This  module  (DEPine  Pset)  responds  requests  for 
primitive  set  definition.  The  calling  control  block  contains  the 
length  and  the  type  of  the  data  field,  and  the  size  of  the 
I D_ARRAY .  (It  could  be  argu<  i  that  the  last  item  shouldn’t  be 
passed  since  it  relates  to  the  internal,  stored  format  of 
primitive  elements  which  is  theoretically  unknown  to  its  definer. 
Presently,  however,  it  is  included  in  the  interface  merely 
because  a  separate  interface  for  the  DBA  to  express  his  opinion 
on  this  matter  is  lacking.  This  issue  will  be  further 
discussed.)  The  return  control  block  contains  the  ID  of  this 
Pset,  which  is  (but  the  upper  level  shouldn't  care)  the  ID  that 
the  Memory  Management  Level  assigned  to  the  catalogue  entry  BEU 
of  this  Pset. 

DEFB ■  This  module  (DEFine  Bset)  responds  to  requests  for 
binary  association  set  defintion.  The  calling  control  block 
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contains  the  Pset  ID's  of  the  source  and  the  target  Psets 
involved  and  its  relationship  type  (i.e.,  one-to-one, 
many-to-one) .  The  return  control  block  contains  the  ID  assigned 
to  this  Bset,  which  is  equivalent  to  the  ID  that  the  Memory 
Management  Level  assigned  to  the  catalogue  entry  BEU  of  this 
Bset . 


5.2.3  DATA  MANIPULATION  AT  THE  INTERNAL  SCHEMA  LEVEL 


This  section  describes  the  two  T-proc ' s  that  form  the  data 
manipulation  interface  of  this  level:  RETN  and  UPDN. 

RETN .  This  module  (RETrieval  at  iNternal  schema  level) 
accepts  a  reasonably  complicated  query  expressed  in  a  tree  form 
in  which  nodes  are  Psets  and  arcs  are  Bsets.  An  arbitrary  number 
of  nodes  can  be  included  in  the  retrieval  tree.  As  an  example,  a 
query  of  the  form 

RETRIEVE  EMP  (NAME,  DEPT ( DNAME ) ,  PROJ (NAME) )  WHERE  (AGE>50  AND 
DEPT(LOC)  =  'New  York') 

can  be  expressed  in  a  RETN  tree  shown  in  the  following  figure. 
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Figure:  The  RETN  Tree  of  an  Example  Query 
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The  caller  of  RETN  passes  a  link  list  of  RETN  calling  control 
blocks,  each  of  the  control  blocks  describing  a  node  in  the  tree. 
The  declaration  of  this  control  block  is: 


DCL  1  RETN_ARG  BASED ( P ) , 

2  LEN  FIXED  BIN  (15)  INIT  (61), 

2  CBTP  FIXED  BIN  (15)  INIT(  25  ), 

2  PTR  PTR  INIT  (NULL), 

2  NODE  FIXED  BIN  (15)  INIT(l),  /*NODE  NUMBER*/ 

2  PSETID  BIT( 32 ) ,  /*PSETID  OF  THE  NODE*/ 

2  PARENT  FIXED  BIN  (15)  INIT(O),  /* PARENT  NODE  NUMBER*/ 

2  BSETID  BIT( 32 ) ,  /*BSETID  OF  THE  PARENT  PSET*/ 

2  GET  BI T ( 8 )  INIT  (' 00000000 ’ B ) ,  /*SEE  RETNGET  FOR  DETAIL*/ 

2  N  FIXED  BIN  INIT(0),  /*NUMBER  OF  RELEVANT  'OR'  PREDICATES*/ 

2  PRED  ( 1 ) , /* I N  CURRENT  VERSION  ONLY  ONE  PREDICATE  EACH  TIME 
IS  ALLOWED;  FUTURE  VERSION  MAY  USE  REFER  OPTION  TO  N*/ 

3  CN  FIXED  BIN  (15),  /*CONDITION  NUMBER*/ 

3  SETOP  BIT( 8 ) ,  /*RELEVANT  IF  BSET  IF  MULTI -TARGET; 

NOT  USED  IN  CURRENT  VERSION*/ 

3  OP  BIT(  8 )  ,  ^COMPARISON  OPS,  SEE  RETNOP  FOR  DETAIL*/ 

3  DLEN  FIXED  BIN  (15)  INIT(0),  /*  LEN  OF  COMPARE  DATA  IN  BYTES*/ 
3  DATA  BIT( 320 ) ;  /*40  BYTES  MAXIMUM*/ 


where  NODE  is  the  node  number  of  the  node  being  described,  PARENT 
is  the  node  number  of  the  predecessor,  BSETID  is  the  ID  of  the 
Bset  which  leads  the  parent  node  to  this  node  (i.e.,  the  'arc'), 
GET  indicates  whether  all,  any  or  none  of  the  qualified 


occurrences  of  this  Pset  are  to  be  retrieved,  and  PRED  describes 
restriction  of  values  of  this  node  (i.e.,  a  predicate).  N,  CN 
and  SETOP  are  currently  unused. 

RETN  returns  occurrences  of  the  tree.  The  return  data  is  a 
link  list  of  the  RETN  return  control  blocks.  Every  control  block 
in  the  link  list  describes  one  of  the  primitive  data  elements 
retrieved.  The  format  of  the  return  control  block  is: 


DCL  1  RETN_RTN  BASED { P) , 

2  LEN  FIXED  BIN  (15)  INIT  (4), 

2  CBTP  FIXED  BIN  (15)  INIT(  26  ), 

2  PTR  PTR  INIT  (NULL), 

2  RTN_CODE  FIXED  BIN  INIT  (0), 

2  N  FIXED  BIN  ( 15 ) ; /*NUMBER  OF  INSTANCES  OF  ROOT  NODE  RETURNED*/ 
DCL  1  RETN_RTN1  BASED ( P ) , 

2  LEN  FIXED  BIN  (15)  INIT  (46), 

2  CBTP  FIXED  BIN  (15)  INIT(  27  ), 

2  PTR  PTR  INIT  (NULL), 

2  NODE  FIXED  BIN  (15),  /*NODE  NUMBER*/ 

2  INDX  FIXED  BIN  (15),  /*IF  MULTI  OCCUR*/ 

2  DLEN  FIXED  BIN,  /*LEN  OF  DATA  IN  BYTES*/ 

2  DATA  BIT( 320) ;  /*DATA  RETURNED*/ 


As  an  example,  suppose  two  employees  are  found  to  satisfy  the 
previous  query,  the  link  list  representing  the  return  will  look 
like  that  in  the  following  figure. 
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This  module,  given  the  RETN  request,  uses  a  very  simple  method 
to  traverse  the  database.  It  first  visits  the  root  node  and 
obtains  the  first  occurrence  of  the  root  node.  It  then  verifies 
the  occurrence  of  the  rest  of  the  tree  against  the  predicate  (if 
any).  If  the  occurrence  is  found  to  be  valid,  a  subroutine  BUILD 
is  called  to  generate  the  data  and  chain  them  to  the  return  link 
list.  If  the  occurrence  is  not  valid,  then  it  discards  the 
current  occurrence  and  gets  the  next  occurrence  of  the  root  node. 
It  continues  this  procedure  until  all  occurrences  in  the  root 
node  are  examined,  or  when  one  valid  occurrence  is  found  if  the 
GET  field  of  the  root  node  in  the  request  tree  indicated  'ANY'. 
The  way  it  verifies  an  occurrence  is  to  follow  the  RETN  tree  to 
establish  occurrences  of  its  associated  elements  and  to  verify 
their  content  against  their  predicates.  If  any  mismatch  is 
found,  the  current  occurrence  is  considered  invalid  and  a  new 
root  occurrence  started. 

This  module  uses  several  subroutines  to  complete  its 
procedure.  RETP  is  called  to  retrieve  the  ID  of  the  next 
P-element  of  a  Pset  on  the  forward  chain  of  the  Pset;  RETB 
retrieves  the  ID  of  the  associated  P-element  in  a  certain  Bset  of 
a  P-element  whose  ID  is  given;  VERIF  verifies  the  value  of  a 
P-element  against  a  predicate;  and  BUILD  builds  the  RETN  return 
control  block  link  list  based  on  a  data  structure  CURSOR,  which 
contains  the  ID's  of  P-elements  of  one  occurrence  of  the  tree. 
In  addition,  it  calls  GPCT  and  GBCT  to  obtain  catalogue  entries 
of  relevant  Psets  and  Bsets. 
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UPDN .  This  module  (UPDate  at  iNternal  schema  level)  creates, 
deletes  and  modifies  data  elements  and  their  relationship  in  the 
database.  Like  RETN,  the  update  argument  is  expressed  in  a  tree 
called  an  UPDN  request  tree.  The  UPDN  tree  is  slightly  different 
from  RETN  tree  in  that  the  operations  are  different.  However, 
the  general  fromat,  i.e.,  a  link  list  of  control  blocks  each 
describing  a  node  in  the  tree,  is  the  same. 

Update  operations  in  a  database  ultimately  include  creating, 
deleting  and  modifying  primitive  data  elements  and  their 
relationship  to  others.  To  alleviate  the  caller  from  the  burden 
of  creating  individual  P-elements  one  by  one  and  then  creating 
linkages  among  them  one  by  one,  the  tree  form  enables  it  to 
express  a  meaningful  aggregate  of  them  in  one  UPDN  request.  For 
example,  a  database  update  request  'Remove  employee  John  from 
Project  A'  can  be  translated  by  the  levels  above  this  level  into 
a  UPDN  tree  shown  in  the  following  figure. 


Figure:  Example  of  a  UPDN  Tree 
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As  shown  in  the  figure,  each  non-root  node  carries  with  it  an 
identifier  for  the  arc  (i.e.,  the  Bset  ID),  an  operation  (i.e., 
OP)  and  possibly  a  data  (i.e.,  ='John').  The  possible  operations 
are  Insert  arc.  Delete  arc.  Replace  arc,  Create  P-element  and 
then  insert  arc,  Delete  arc  and  also  the  P-element,  Replace  value 
of  P-element,  and  Identity.  The  identify  operator  is  used  when 
the  node  does  not  require  any  update  but  is  included  in  the  tree 
for  the  purpose  of  identifying  the  occurrence  of  its  predecessor 
nodes.  The  root  node  operations  are  Delete,  Create  and  Modify. 
(These  operations  are  declared  in  the  data  structure  UPDNOP.)  In 
our  example,  the  operation  involved  is  to  'de-associate'  the 
P-element  representing  employee  John  from  the  P-element 
representing  Project  A.  Therefore  an  arc  between  these  two 
P-elements  must  be  deleted.  However,  to  'pin  point’  the 
occurrence  of  these  two  P-elements,  two  ID  nodes  are  used  (i.e., 
ENAME= ' John '  and  PNAME= ' A ' . ) 

The  UPDN  request  is  expressed  as  a  link  list  of  control  blocks 
UPDN_ARG.  Declaration  of  UPDN_ARG  is  as  follows: 

DCL  1  UPDN_ARG  BASED (P), 

2  LEN  FIXED  BIN  (15)  INIT  (56), 

2  CBTP  FIXED  BIN  (15)  INIT(  30  ), 

2  PTR  PTR  INIT  (NULL), 

2  NODE  FIXED  BIN  (15)  INIT( 1 ) , /*NODE  NUMBER  OF  UPDN  TREE*/ 

2  PSETID  BIT  (32),  /*PSETID  OF  THE  NODE*/ 

2  PARENT  FIXED  BIN  (15)  INIT(O),  /*PARENT  NODE  NUMBER*/ 
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2  BSETID  BIT  (32),  /*BSETID  OF  PARENT  PSET  LEADING  HERE*/ 

2  OP  FIXED  BIN  (15),  /*OP  CODE  FOR  UPDN;  SEE  UPDNOP  FOR  DETAIL*/ 
2  DLEN  FIXED  BIN  (15)  INIT(O),  /*IN  NUMBER  OF  BYTES*/ 

2  DATA  BIT( 320 ) ;  /*MAX  40  BYTES  OF  IMMED  DATA  */ 

where  NODE,  PSETID,  PARENT  and  BSETID  have  the  same  meaning  as 
those  in  RETN_ARG  described  above,  OP  is  the  operation  code,  and 
DLEN  and  DATA  are  data  to  be  created  or  data  used  to  identify 
itself  and  others. 

The  UPDN_RTN  control  block  returns  a  return  code  either 
confirming  the  operation  or  indicating  problems  encountered  in 
the  processing. 

The  method  used  by  UPDN  to  process  a  request  is  as  follows: 

1.  Make  a  pass  through  the  UPDN  request  to  fill  up  a  data 
structure  TEMP  which  is  used  to  remember  all  nodes  which  have  any 
child  node  whose  operation  code  is  'ID'  (i.e.,  Identity);  2.  Use 
TEMP,  working  from  the  bottom  of  the  tree  to  top,  resolve  all 
predicates;  reduce  the  original  tree  to  a  2-level  tree  without 
any  ID-operation  nodes;  3.  Pass  the  reduced  tree  to  subroutines 
CRTN,  DELN  or  MODN  depending  on  UPDN. OP  at  the  root  node. 

The  UPDN  module  makes  use  of  RETN  to  resolve  identity  of  nodes 
which  have  child  nodes  with  OP  code  ’ID'.  Subroutines  MODN,  DELN 
and  CRTN  will  further  call  CRTP,  CRTB ,  DELP,DELB,  REPP,  and  REPB 
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subroutines  to  perform  actual  update  of  BEU's  based  on  the  OP 
codes  of  the  nodes  in  the  reduced  tree. 


5.2.4  INITIALIZATION  AT  INTERNAL  SCHEMA  LEVEL 

NINIT .  This  module  (iNternal  schema  level  INITialization)  is 
invoked  during  IPL  by  the  upper  level  to  initialize  system 
databases.  It  first  invokes  MINIT  which  performs  initialization 
of  all  levels  below.  If  initialization  is  'file',  then  MINIT 
will  return  a  one-word  key  which  NINIT  can  use  to  recover  its 
system  databases  by  retrieving  a  BEU  using  the  key  as  its  ID. 
This  BEU  contains  values  for  PCATID,  BCATID  and  another  key  that 
NINIT  shall  return  to  the  upper  level.  In  this  way  NINIT  sets  up 
the  static  variable  PCATID  and  BCATID,  which  are  to  be 
read-accessed  by  several  modules  in  this  level  when  normal 
processing  starts. 

If  the  initialization  is  'new',  then  NINIT  has  to  bootstrap 
its  system  databases.  It  does  this  by  allocating  the  PCAT 
catalogue  entry  BEU  and  directly  calls  subroutine  CRT1  to  store 
it  in  the  Storage  Hierarchy.  (CRT1  is  a  subroutine  which 
interfaces  with  the  CRT  procedure  at  the  MM  Level.)  Once  PCAT 
catalogue  entry  is  in  the  database,  NINIT  uses  DEFP  to  define  the 
second  Pset  of  the  system  database:  the  BCAT  Pset.  After  both 
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Psets  are  defined,  PCATID  and  BCATID  values  will  be  set  and  NINIT 
then  returns. 

NINIT  also  provides  an  interface  for  the  upper  level  to  store 
a  one-word  key  for  that  level.  This  key,  together  with  PCATID 
and  BCATID,  will  be  stored  as  a  BEU  in  the  Storage  Hierarchy. 
The  ID  of  this  BEU  then  becomes  the  key  of  this  level,  and  is 
stored  by  calling  the  MINIT  Store  Key  function. 


5.2.5  SUBROUTINES  AT  INTERNAL  SCHEMA  LEVEL 


Most  of  the  subroutines  in  this  level  have  been  briefly 
described  in  the  previous  subsecton.  There  are  3  for  catalogue 
management:  GPCT  \Get  Pset  CaTalouge  entry),  GBCT  (Get  Bset 
CaTalogue  entry)  and  UPCT  (UPdate  Pset  CaTalogue  entry),  4  for 
retrieval  operations:  RETP  (RETrieve  next  P-element),  RETB 
(RETrieve  the  Binary  associated  element),  VERIF  (VERIFy)  and 
BUILD,  6  for  update  operations:  CRTP  (CReaTe  P-elemtn),  CRT3 
(CReaTe  Binary  association),  DELP  (DELete  P-element),  DELB 
(DELete  Binary  association),  MODP  (MODify  P-element)  and  MODB 
(MODify  Binary  association),  and  4  for  interfacing  with  the  MM 
Level:  CRT1,  DELI,  REP1  and  RET1.  The  last  group  each  interfaces 
with  one  procedure  at  the  MM  Level,  and  basically  takes  a  BEU  as 
input  and  generate  appropriate  request  to  be  passed  down. 


5 . 3  ENTITY  LEVEL 


This  level  processes  semantics  of  the  database.  It  accepts 
definition  of  entity  sets,  attributes  and  constraints  and 
responds  to  commands  to  manipulate  entities. 


5.3.1  DATA  STRUCTURES  AT  ENTITY  LEVEL 


This  level  views  the  world  as  a  collection  of  entities  and 
attributes  of  these  entities.  This  entity  network  data  model  has 
been  described  in  section  2.2. 

Mapping  between  the  entity  network  and  the  data  structures 
implemented  in  the  Internal  Schema  Level  is  as  follows.  Every 
node  in  the  entity  network  graph  is  implemented  as  a  Pset ,  and 
every  arc  in  the  graph  a  Bset.  While  the  Entity  Level  is 
responsible  for  making  these  Psets  and  Bsets  known  to  the 
Internal  Schema  Level  (through  DEFP  and  DEFB  calls),  it  is  not 
concerned  about  how  data  in  these  sets  are  actually  stored. 
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5.3.2  SYSTEM  DATABASES  AND  DATA  DEFINITION  MODULES  AT  ENTITY 
LEVEL 


This  level  keeps  two  catalogues:  the  entity  catalogue  and  the 
attribute  catalouge.  An  entry  in  the  former  describes  an  entity 
set  and  an  entry  in  the  latter  describes  an  attribute  of  an 
entity  set.  These  two  catalogues  are  themselves  implemented  as 


two  entity  sets:  E*ESET  and  E*ASET.  They  are  displayed  in  the 
following  figure. 


Figure:  Catalogue  structure  at  Entity  Level 


E*ESET  has  two  'attributes'  A*ENAME  and  A*EINFO.  The  former 
contains  the  name  of  the  entity  set  this  catalogue  entry  is 
describing,  and  the  latter  contains  the  ID  of  the  Pset 
implementing  this  entity  set,  which  is  provided  for  by  the 
Internal  Schema  Level  in  response  to  a  DEFP  request. 

E*ASET  has  three  'attributes'.  A*ANAME  conatins  the  name  of 
the  attribute.  A*AINFO,  an  encoded  attribute,  contains  a  data 
structure  declared  as  follows: 

/**  CATALOGUE  STRUCTURES  AT  THE  ENTITY  LEVEL****/ 

DCL  1  AINFO, 

2  BSETID  BIT  (32),  /*BSETID  OF  THIS  ATTRIBUTE**/ 

2  PSETID  BIT  (32),  /*PSETID  OF  TARGET  NODE**/ 

2  ENAME  CHAR  (8),  /*IF  TARGET  IS  A  ENTITY  SET*/ 

2  MAX  FIXED  BIN  (31), 

2  MIN  FIXED  BIN  (31) , 

2  MLEN  FIXED  BIN, 

2  FUNC  CHAR ( 1 ) , 

2  TYPE  CHAR  ( 1 ) , 

2  VTYPE  CHAR  ( 1 ) ; 

where  BSETID  is  the  ID  of  the  Bset  implementing  the  association 
between  the  Pset  that  implements  the  entity  set  this  attribute 
belongs  to  and  the  Pset  that  implements  the  domain  of  this 
attribute.  This  ID  is  produced  by  the  Internal  Schema  Level  in 
response  to  a  DEFB  request.  PSETID  is  the  ID  of  the  Pset 
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implementing  the  domain  of  the  attribute.  ENAME  is  the  name  of 
the  domain  entity  set  if  this  attribute  is  an  entity  attribute. 
TYPE  specifies  the  type  of  this  attribute  (i.e.,  entity  or 
value).  If  it  is  a  value  type  attribute,  VTYPE  specifies  the 
value  type  (i.e.,  character  string  or  numeric),  and  MLEN 
specifies  the  maximum  length  in  terms  number  of  characters  or 
number  of  digits  this  attribute  will  have,  and  MAX  and  MIN 
provide  the  value  range  of  the  numeric  attribute.  These 
parameters  are  given  by  the  DBA  during  the  data  definition 
session  described  in  section  2.2. 

The  third  attribute  of  E*ASET  is  A*ESET .  It  is  an  entity 
attribute  whose  domain  is  the  E*ESET  entity  set.  This  attribute 
has  a  relationship  type  many-to-one,  which  means  that  many  E*ASET 
entities  may  be  related  to  one  E*ESET  entity.  This  attribute 
specifies  the  entity  set  this  attribute  belongs  to. 

Two  T-proc's  form  the  data  definition  interface  at  this  level; 
DEFE  (DEFine  Entity  set)  and  DEFA  (DEFine  Attribute).  They  are 
invoked  by  the  DDB  module  in  the  User  Interface  Level.  Both 
modules  will  check  a  definition  request  against  duplicate  names. 
They  will  then  call  subroutines  DFP1  and  DFB1  to  formulate  DEFP 
and  DEFB  requests  to  be  passed  to  the  Internal  Schema  Level.  To 
update  catalogues,  both  modules  make  use  of  UPDE,  the  data 
manipulation  module  at  this  level,  since  the  catalogues  are 
themselves  entity  sets.  This  greatly  simplifies  the  logic  of 
these  two  modules. 
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Another  module,  SHWE  (SHoW  Entity  level  catalogue)  will,  when 
invoked,  retrieve  the  catalogue  entries  and  decode  the  attribute 
information  for  display  by  the  User  Interface  Level.  In 
retrieving  catalogue  entries,  all  three  modules  (DEFE,  DEFA  and 
SHWE)  make  use  of  subroutines  GECT,  GACT  and  ALLA,  which  will  be 
described  later. 


5.3.3  DATA  MANIPULATION  AT  ENTITY  LEVEL 


RETE.  This  module  (RETrieve  Entities)  is  passed  a  tree-like 
retrieval  request.  The  root  node  describes  the  entity  set  of 
which  information  is  being  requested,  and  the  leaf  nodes  describe 
the  attributes  of  interest  of  this  entity  set.  Predicates  on  the 
attributes,  if  any,  are  passed  along  with  the  leaf  nodes.  The 
request  is  represented  by  a  link  list  of  RETE  calling  control 
blocks  RETE_ARG.  Each  control  block  describes  one  node  in  the 
retrieval  tree.  Declaration  of  RETE_ARG  is  as  follows: 

DCL  1  RETE_ARG  BASED(P), 

2  LEN  FIXED  BIN  (15)  INIT  (61), 

2  CBTP  FIXED  BIN  (15)  INIT(  21  ), 

2  PTR  PTR  INIT  (NULL), 

2  NODE  FIXED  BIN  (15)  INIT(l),  /*NODE  NUMBER*/ 

2  NAME  CHAR  (8),  /*ANAME  OR  ENAME*/ 


>< 
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2  PARENT  FIXED  BIN  (15)  INIT(O),  /* PARENT  NODE  NUMBER*/ 

2  GET  BIT(8)  INIT  (' 00000000 ' B ) ,  /*SEE  RETEGET  FOR  DETAIL*/ 
2  N  FIXED  BIN  INIT(O),  /*NUMBER  OF  RELEVANT  ’OR’ 
PREDICATES*/ 

2  PRED  (1)/*IN  THIS  VERSION  ONLY  ONE  PREDICATE  EACH  TIME  IS 
ALLOWED;  IN  THE  FUTURE  MAY  USE  REFER  OPTION  TO  N*/, 

3  CN  FIXED  BIN  (15)  INIT(l) ,/*CONDITION  NUMBER*/ 

3  SETOP  BIT(8),  /*RELEVANT  IF  BSET  IF  MULTI -TARGET; 

NOT  USED  IN  CURRENT  VERSION*/ 

3  OP  BIT( 8 ) ,  /*COMPARI SON  OPS,  SEE  RETEOP  FOR  DETAIL*/ 

3  DLEN  FIXED  BIN  (15)  INIT(O),  /*  LEN  OF  COMPARE  DATA  IN 

BYTES*/ 

3  CDATA  CHAR  (40);/*40  BYTES  MAXIMUM*/ 

where  NODE  and  PARENT  have  similar  meaning  as  those  in  the 
RETN_ARG  control  block  (section  5.2.3),  NAME  is  either  the  entity 
set  name  if  it  is  a  root  node,  or  the  attribute  name  if  it  is  a 
leaf  node,  GET  indicates  whether  to  get  all,  any  or  none  of  the 
qualified  occurrences  of  this  attribute.  Under  PRED,  OP  refers 
to  a  comparison  operator  (i.e.,  >,  <  or  =),  DLEN  and  CDATA  are 
the  length  and  the  character  form  of  the  predicate  data.  N,  CN 
and  SETOP  are  currently  not  used. 

The  RETE  module  retrieves  catalogue  entries  of  all  entity  sets 
and  attributes  involved  in  the  RETE  request  by  subroutine  calls 
to  GACT  and  GECT,  which  retrieve  attribute  information  and 
entity  set  information.  Any  undefined  name  found  will  cause  the 
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request  to  be  rejected  with  the  unfound  name  pointed  out. 
Catalogue  information  is  also  used  to  verify  and  transform  the 
predicate  values  passed  along  with  the  request.  Transformation 
is  necessary  since  the  internal  representation  of  data  may  not 
always  take  the  charactaer  form.  Data  type  transformation  and 
verification  are  done  through  a  subroutine  VTPE.  Once  all  these 
are  done,  a  RETN  request  will  be  formulated  and  passed  to  the 
RETN  module  at  the  Internal  Schema  Level.  When  the  latter 
returns,  its  answer  set  will  be  used  to  generate  RETE's  answer 
set,  which  is  a  link  list  of  RETE_RTN  control  blocks.  The 
RETE_RTN  control  block  is  similar  to  that  of  the  RETN_RTN  control 
block  except  that  DATA  is  now  in  character  form  ready  to  be 
displayed. 

UPDE.  This  module  (UPDate  Entities)  is  invoked  to  create, 
delete  and  modify  entities  in  the  entity  sets  already  defined. 
UPDE  is  also  passed  a  tree-like  request,  where  the  root  node 
describes  the  entity  set  of  which  occurrences  are  to  be  updated, 
and  the  leaf  nodes  describe  the  attributes  which  are  either  used 
to  identify  the  occurrences  to  be  updated,  created  or  added  to. 
The  UPDE  request  and  its  return  control  blocks  are  similar  to 
those  of  the  UPON  module. 

UPDE  performs  validity  checking  on  the  attributes  being 
passed.  Any  violation  of  validity  constraints  defined  for  the 
values  of  the  attributes  will  cause  the  request  to  be  rejected 
entirely,  with  the  faulty  attribute  pointed  out.  UPDE  also  calls 
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subroutines  GECT,  GACT  and  VTPE  for  catalogue  retrieval  and  data 
type  verification  and  transformation.  After  all  these  are  done, 
UPDE  formulates  a  UPDN  request  to  be  passed  to  the  Internal 
Schema  Level  to  update  P-elements  and  their  relationships. 

UPDE  returns  a  return  code  confirming  the  success  of  the 
operation  or  pointing  out  why  it  has  failed. 

VNME .  This  module  (Verify  NaMEs)  is  invoked  by  some  User 
Interface  Modules  to  verify  the  entity  names  and  attribute  names 
a  user  has  typed  in  before  he  enters  the  data.  This  is  provided 
so  that  a  user  will  get  a  more  responsive  system  interface.  The 
calling  control  block  VNME_ARG  contains  an  array  of  names 
structured  in  a  tree  form.  VNME  will  verify  these  names  against 
the  catalogues  at  the  Entity  Level  and  point  out  problems  if 
there  is  any. 


5.3.4  INITIALIZATION  AT  ENTITY  LEVEL 


VINIT.  This  module  initializes  system  databases  at  this 
level.  Like  NINIT,  when  it  is  invoked,  it  first  calls  the 
initialization  module  at  the  lower  level  to  initialize  all  the 
lower  levels.  Depending  on  the  method  of  initialization  (file  or 
new),  it  either  receives  a  one-word  key  back  based  on  which  it 
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recovers  its  system  databases,  or  it  has  to  bootstrap  the  system 
databases  into  the  Storage  Hierarchy. 

To  bootstrap  its  system  databases  which  are  the  first  two 
entity  sets  of  the  system,  VINIT  calls  DEFP  6  times  and  DEFB  5 
times  to  set  up  the  Psets  and  Bsets  involved  in  the  catalogues. 
The  11  ID's  thus  generaged  are  then  stored  in  yet  another  special 
Pset  (the  7th  Pset  that  VINIT  has  defined)  by  calling  UPDN.  The 
ID  cf  the  7th  Pset  is  then  stored  as  the-  key  of  this  level  by 
invoking  the  Store  Key  function  of  the  NINIT  procedure.  The  11 
ID's  are  also  retained  in  a  static  array  KEY  which  can  be 
read-accessed  by  the  catalogue  management  subroutines  GACT,  GECT 
and  ALLA  at  this  level. 

Another  subroutine  EBOT  (Entity  catalog  Bootstrap)  is  called 
by  VINIT  to  put  into  these  6  Psets  and  5  Bsets  the  definition  of 
the  catalogues.  (Since  the  catalogues  are  themselves  entity  sets 
with  attributes,  their  definitions  will  be  the  first  to  appear  as 
data  in  these  Psets  and  Bsets.)  EBOT  uses  7  UPDN  calls  to 
accomplish  this  task. 

If  initialization  is  from  an  existent  database,  VINIT  will 
retrieve  the  11  ID's  back  by  accessing  the  Pset  whose  ID  is 
returned  to  VINIT  by  NINIT  as  the  one-word  key. 
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5.3.5  SUBROUTINES  AT  ENTITY  LEVEL 

The  six  subroutines  have  been  introduced  briefly  in  the 
previous  subsections.  Three  are  catalogue  management 
subroutines:  GECT  (Get  Entity  CaTaiogue  entry),  GACT  (Get 
Attribute  CaTaiogue  entry)  and  ALLA  (get  ALL  Attributes).  ALLA 
is  invoked  by  SHWE  when  the  user  wishes  to  find  out  all 
attributes  defined  for  a  particular  entity  set.  All  three 
modules  make  use  of  the  KEY  array  to  get  the  ID's  of  the  Psets 
and  Bsets  forming  the  catalogues,  and  formulates  a  RETN  request 
to  obtain  these  data.  Subroutines  for  retrieving  attribute 
catalogue  entries  also  perform  the  task  of  decoding  a  bit  string 
into  elements  in  the  AINFO  data  structure  for  direct  use  by  the 
caller . 

Theoretically  there  is  no  need  for  a  set  of  special  retrieval 
routines  just  to  retrieve  the  catalogue  entries.  Since  the 
catalogue  entries  are  themselves  attributes  of  entities  in  the 
database,  RETE  should  be  able  to  accomplish  the  same  task.  These 
special  routines  are  devised  mainly  for  performance  reasons. 
RETE,  as  it  turns  out,  is  a  very  expensive  module.  Using  RETE  to 
retrieve  catalogue  entries  would  degrade  performance 
dramatically.  While  performance  of  the  system  is  not  a  primary 
concern  at  this  stage,  it  was  felt  that  this  deviation  from 
theoretical  elegance  was  worthwhile  in  the  current 
implementation.  Performance  of  a  multi-layered  database 
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architecture  is  a  future  research  issue  which  may  provide  clues 
to  whether  this  deviation  can  be  (or  should  be)  avoided. 

Another  two  of  the  subroutines,  DFB1  and  DFP1,  are  used  to 
generate  DEFB  and  DEFP  requests  in  the  proper  format  to  be  passed 
to  the  next  level.  Finally,  subroutine  VTPE  (Verify  TyPE)  is 
used  to  verify  and  transfrom  data  passed  along  with  the  RETE  or 
UPDE  requests. 


5.4  THE  USER  INTERFACE  LEVEL 


This  level  interacts  directly  with  the  user.  It  does  not 
create  or  use  any  system  database.  Its  function  is  primarily  one 
which  parses  users'  requests  and  generates  in  proper  formats 
requests  to  be  passed  down  to  the  Entity  Level.  Therefore  the 
usual  classification  of  modules  into  data  definition,  data 
manipulation  and  initialization  modules  is  not  used  here. 


5.4.1  USER  INTERFACE  MODULES 
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USER.  This  module  is  invoked  when  a  user  'logs  on'. 
(Presently  there  is  no  security  checking  facility.)  USER  simply 
asks  for  the  subsystem  the  user  wishes  to  get  in.  Only  DBA 
subsystem  is  currently  available.  USER  then  passes  control  to 
the  DBA  module. 

DBA.  This  module  (Data  Base  Administrator  session)  takes 
control  when  a  user  enters  the  DBA  session.  It  calls  various 
subsroutines  depending  on  what  the  user  wishes  to  do:  data 
definition  (DDB),  data  definition  query  (DDQ)  or  data 
manipulation  (DDM) .  These  three  subroutines  are  described  in  the 
following  paragraphs. 

DDB.  This  module  (Data  Definition  for  Base  schema)  is  invoked 
to  interface  with  a  DBA's  request  to  do  data  definition  for  the 
base  schema.  (A  base  schema  is  a  schema  which  describes  the 
integrated  database  in  terms  of  constructs  in  the  entity  network 
data  model.  It  is  different  from  a  view  schema  which  describes  a 
view  in  terms  of  a  data  model  which  is  not  necessarily  the  base 
data  model.  Presently  no  view  facility  is  available.)  A  user 
may  define  an  entity  set  and  then  its  attributes.  He  may  also 
add  attributes  to  an  entity  set  defined  previously.  The  DDB 
module  interfaces  with  the  user  through  a  panel  facility.  The 
panel  facility  will  display  pre-defined  panels  at  the  user's 
terminal  and  allow  the  user  to  respond  by  filling  out  blanks  on 
the  panel. 
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This  module  will  formulate  DEFE  and  DEFA  requests  to  be  passed 
down  to  the  Entity  Level  based  on  parameters  the  user  specifies 
in  the  panels. 

DDQ.  This  module  (Data  Definition  Query)  is  invoked  to 
display  content  of  data  definitions.  Its  major  task  is  to 
formulate  properly  a  SHWE  request  to  be  passed  to  the  Entity 
Level.  When  SHWE  returns,  DDQ  displays  the  result  at  the  user's 
terminal . 

DMB .  This  module  (Data  Manipulation  for  Base  data)  is  invoked 
when  a  user  enters  a  data  manipulation  session.  It  calls 
subroutines  DMQ,  DMC ,  DMM  and  DMD  based  on  the  type  of 
manipulation  operations.  These  subroutines  are  described  below. 

DMQ.  This  module  (Data  Manipulation  -  Query)  accepts  a  user's 
query  and  parses  it  into  meaningful  tokens  to  be  placed  in  a  RETE 
request.  It  calls  subroutin  LEX  to  break  the  input  characater 
string  into  tokens.  Then  it  uses  subroutine  LEXT  to  recognize 
the  tree  structure  of  the  query.  Once  data  structures  describing 
the  tree  have  been  produced  by  LEXT,  DMQ  formulates  a  RETE 
request  and  passes  it  to  the  Entity  Level.  Upon  receiving  return 
data  from  the  latter,  DMQ  calls  subroutine  PRNT  to  display  the 
result  at  the  user's  terminal. 

DMC.  This  module  (Data  Manipulation  -  Creating  entities) 
accepts  a  user's  request  to  create  entities  in  pre-defined  entity 


sets.  The  user  first  provides  a  list  of  attributes  whose  values 
will  be  provided  when  an  entity  is  created.  DMC  will,  like  DMQ, 
call  LEX  and  LEXT  to  build  a  tree  out  of  the  list  of  attribute 
names  and  formulate  a  VNME  request  to  be  passed  to  the  Entity 
Level.  The  latter  validates  these  names  against  the  entity  level 
catalogues.  If  no  error  is  detected  in  the  attribute  list,  DMC 
then  asks  the  user  to  enter  data  for  these  attributes.  Every 
line  of  data  entered  will  cause  one  entity  to  be  created.  DMC 
uses  subroutine  UPE1  to  input  data  lines  and  to  formulate  UPDE 
requests.  Violation  of  constraints  on  data  types  or  data  values 
will  be  signaled  through  a  return  code  from  UPDE  and  DMC  will 
display  proper  error  messages  based  on  the  return  code. 

DMM  and  DMD .  These  two  modules  (Data  Manipulation  -  Modify 
entities  and  Data  Manipulation  -  Delete  entities)  are  similar  to 
DMC  in  thier  operations. 


5.4.2  OTHER  SUBROUTINES  AT  USER  INTERFACE  LEVEL 


This  subsection  describes  the  5  subroutines  used  by  modules 
described  in  the  previous  subsection. 


LEX.  This  module  (LEXical  analyzer)  breaks  input  lines  into 


tokens.  Token  delimiters  recognized  are  and  Delimiters 
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enclosed  in  quotes  are  not  treated  as  exceptions.  More  than  one 
line  of  input  can  be  strung  together  by  ending  previous  lines  in 
back  slashes.  Blanks  can  be  optionally  taken  out  of  the  input 
character  string.  However,  blanks  enclosed  in  quotes  are  not 
suppressed.  This  module  returns  an  array  TOKEN  which  contains 
the  tokens  and  their  lengths.  (Note  that  the  fact  that 
delimiters  found  in  quotes  are  not  taken  as  exceptions  means  that 
this  current  implementation  of  lexical  analyzer  cannot 
accommodate  data  values  that  contain  these  special  characters.) 

LEXT.  This  module  (LEXical  Tree  structure)  is  given  the  array 
TOKEN  produced  by  subroutine  LEX  and  is  asked  to  identify  the 
hierarchical  structure  of  names  and  data  values  implied  by  the 
nested  parantheses.  For  example,  if  TOKEN ( 1 )  is  ' EMPLOYEE ( ' , 
TOKEN ( 2 )  is  'EMPNAME'  and  TOKEN(3)  is  ’ EMPADDR ) ’ ,  then  EMPNAME 
and  EMPADDR  are  the  children  names  of  the  name  EMPLOYEE.  This 
module  is  also  required  to  recognize  non-name  tokens.  There  are 
two  types  of  non-name  tokens:  the  modification  operators  (MOP) 
and  the  predicate  values.  The  former  is  distinguished  from 
regular  name  tokens  by  its  special  starting  character  The 
latter  always  trails  a  comparison  operator  ('=',  ’>',  ’<’)  behind 
a  name.  Therefore  if  a  token  is  found  to  contain  a  comparison 
operator,  it  is  broken  into  a  name  token  and  a  value  token.  If  a 
value  is  surrounded  by  quotes,  the  quotes  are  removed. 

This  module  returns  several  data  structures  describing  its 
parsing  results.  Array  T1  contains  the  hierarchical  structure  of 
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names,  array  PRED  contains  value  tokens  and  array  MOP  contains 
modificaton  operators  found  in  the  input  character  string. 

UPE1 .  This  module  (UPdE  interface)  is  used  by  data  update 
modules  (DMC,  DMD  and  DMM)  to  get  input  data  and  to  formulate  a 
UPDE  request  for  each  input  line.  The  caller  will  pass  to  UPE1 
the  tree  structure  of  enitity  and  attribute  names  that  have  been 
recognized  by  LEXT  as  well  as  the  update  operators  (e.g.,  insert, 
delete,  replace)  corresponding  to  the  input  data  items.  UPE1 
makes  use  of  these  data  structures,  calls  LEX  to  break  the  input 
line  into  data  items,  and  formulates  proper  UPDE  requests  to  be 
passed  to  the  Entity  Level. 

VNM1 .  This  module  (VNMe  interface)  is  invoked  by  data  update 
modules  (DMC,  DMD  and  DMM)  to  formulate  proper  VNME  requests  to 
be  passed  to  the  Entity  Level.  This  is  done  to  confirm  the 
legality  of  entity  and  attribute  names  before  accepting  the 
update  data  from  the  user.  This  module  is  passed  a  data 
structure  describing  the  tree  structure  of  the  names  and  will 
return  a  return  code  indicating  any  problem  found. 

PRNT.  This  module  (PRiNT)  performs  the  task  of  displaying  the 
result  of  a  user  query.  It  is  passed  a  pointer  pointing  to  the 
RETE_ARG  chain  and  a  pointer  pointing  to  the  RETE_RTN  chain  and 
will  use  information  contained  in  these  chains  to  display  header 
lines  and  data  lines  at  the  terminal. 


5.5  THE  DRIVER  MODULE  -  FSTV 


The  FSTV  module  is  invoked  by  the  Control  Structure  when 
starting  the  simulation  run.  It  is  the  driver  program  of  the 
Functional  Hierarchy.  The  purpose  of  this  module  is  to  start  up 
initialization  of  the  entire  Functional  Hierarchy  and  to  invoke 
the  user  session. 

System  Traces.  FSTV  first  calls  subroutine  SETFH  which  sets 
up  run  time  parameters.  The  only  run  time  parameters  used  in  the 
current  implementation  are  the  trace  options.  There  are  five 
types  of  trace  options.  The  TCALL  trace  option  will  display 
messages  when  a  T-proc  is  invoked  as  well  as  when  it  returns. 
This  trace  can  be  selected  on  a  level  basis.  It  is  implemented 
through  the  TCALL  program,  since  all  T-proc  invocations 
necessarily  go  through  TCALL. 

The  system  error  message  trace  will  display  messages  when  an 
unusual  situation  is  detected.  This  normally  signals  that  some 
system  software  errors  have  been  detected.  This  trace  can  also 
be  turned  on  and  off  on  a  level  basis. 

The  third  type  of  trace  is  the  memory  request  trace.  If  this 
is  turned  on,  every  data  element  that  has  been  created,  deleted 
or  updated  in  the  Storage  Hierarchy  will  be  displayed  along  with 
its  virtual  address.  It  displays  these  data  elements  using  the 
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BEU  format.  It  is  implemented  within  subroutines  CRT1,  RET1 , 
DELI  and  REP1. 

The  fourth  type  of  trace  is  the  Internal  Schema  Level  data 
manipulation  request  trace.  It  displays  all  the  requests  that  go 
into  the  RETN  and  UPDN  modules.  This  trace  is  implemented  within 
these  two  modules. 

The  last  type  of  trace  is  the  timing  report  option.  It  keeps 
track  of  the  virtual  CPU  time  consumed  by  each  T-proc  (including 
subroutine  calls  within  the  T-proc)  and  the  number  of  times  a 
T-proc  is  invoked.  A  sample  timing  report  is  shown  in  the 
following  figure.  This  option  is  implemented  through  the  TCALL 
module,  and  the  result  is  displayed  at  the  end  of  the  run  by  the 
program  FSTV. 
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LEVEL 

PROCNAME 

COUNT 

TOT  ELAPSED  TIME 

TOT  RUN  TIME 

RUN  TIME/INVOCATION 

1 

USER 

1 

1505283 

80955 

80955 

2 

VINIT 

1 

123976 

5233 

5233 

2 

VNME 

0 

0 

0 

0 

2 

OEFE 

0 

0 

0 

0 

2 

RETE 

1 

1146343 

17482 

17482 

2 

UPOE 

0 

0 

0 

0 

2 

OEFA 

0 

0 

0 

0 

2 

SHWE 

1 

1424328 

11921 

11921 

3 

OEFP 

0 

0 

0 

0 

3 

OEFB 

0 

0 

0 

0 

3 

RETN 

8 

1503249 

567142 

70892 

3 

UPON 

0 

0 

O 

0 

3 

NINIT 

1 

10419 

5637 

5637 

4 

RET 

138 

939625 

939625 

6808 

4 

DEL 

0 

0 

0 

0 

4 

REP 

0 

0 

0 

0 

4 

CRT 

0 

0 

0 

0 

4 

MINIT 

1 

1264 

1264 

1264 

5 

LI 

801 

180119 

1801 19 

224 

Figure:  Sample  Timing  Report 


PAGE  91 


After  SETFH  is  finished,  FSTV  invoices  VINIT  to  initialize  the 
Functional  Hierarchy.  Then  FSTV  invoices  USER,  the  T-proc  at  the 
User  Interface  Level  to  start  up  the  user  session. 
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6.0  CONCLUDING  REMARKS  AND  FUTURE  DIRECTIONS 


This  report  describes  the  current  implementation  of  the 
Software  Test  Vehicle  of  the  Functional  Hierarchy  of  the  INFOPLEX 
database  computer.  It  provides  an  introduction  to  the  STV 
project  and  the  relationships  among  its  various  components,  and 
documents  the  programming  conventions  used  in  FSTV. 

This  current  version  of  FSTV  is  implemented  with  future 
research  and  expansions  in  mind.  It  is  not  meant  to  provide 
detailed  performance  statistics.  Nor  is  it  meant  to  incorporate 
all  the  functionalities  that  a  large  DBMS  should  have.  However, 
it  has  provided  some  interesting  insights  into  issues  that  ought 
to  be  explored  further,  and  a  basis  for  incorporating  future 
efforts. 


6.1  MEMORY  MANAGEMENT  LEVEL  REVISITED 


Segmentation  and  garbage  collection  are  among  the  more 


important  functions  that  are 


missing  in  the 


current 
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implementation.  An  interface  which  allows  the  upper  level  to 
define  segments  and  to  request  that  a  certain  element  be  stored 
in  a  pre-defined  segment  will  produce  a  much  more  logical 
grouping  of  data  elements  in  the  virtual  memory  address  space. 
This  means  that  the  Memory  Management  Level  will  maintain  its  own 
system  database  which  describe  the  availability  of  each  segment, 
where  and  how  this  system  database  is  maintained  are  also  issues 
that  need  to  be  resolved. 


6.2  INTERNAL  SCHEMA  LEVEL  REVISITED 


The  purpose  of  this  level  is  to  provide  the  upper  levels  with 
a  powerful  data  structure  management  facility.  However, 
capabilities  implemented  in  the  current  version  leave  very  much 
to  be  desired.  In  terms  of  functionalities,  the  binary 
association  types,  currently  limited  to  one-to-one  and 
many-to-one,  should  be  expanded  to  include  one-to-many  and 
many-to-many .  Accompanying  this  expansion  is  the  enrichment  of 
the  set  of  primitives  used  to  express  retrieval  and  update 
predicates.  Set-oriented  primitives  such  as  INCLUDE,  BELONG_TO, 
ALL  and  ANY  are  more  efficiently  processed  at  this  level  than  at 
a  higher  level,  therefore  they  ought  to  be  included  in  the  RETN 
requests.  The  predicate  structure  should  also  include  the  OR 


boolean  operator.  In  addition,  the  INVERSE  function  should  also 
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be  provided  for  defintion  of  a  binary  association  which  is  the 
inverse  of  one  already  defined.  This  provides  more  flexibility 
for  the  user  in  phrasing  a  query  while  leaves  the  access  path 
selection  problem  entirely  to  the  Internal  Schema  level. 


In  terms  of  interface,  the  current  definition  and  manipulation 
interface  structure  should  be  more  flexible.  For  example, 
several  Bsets  whose  source  Psets  are  the  same  may  be  defined  in 
one  DEFB  request.  Additional  construct  defintion  may  be 
desirable.  For  example,  an  often  used  retrieval  tree  may  be 
defined  to  be  a  construct  such  that  future  retrieval  requests  may 
simply  cite  the  ID  of  that  construct  without  constructing  the 
same  tree  again.  These  enhancements  will  improve  convenience  of 
use  as  well  as  efficiency  of  operations. 


Those  described  above  are  potential  improvements  that  the 
upper  level  can  see.  Equally  important  are  the  improvements  of 
internal  processing.  Intelligent  query  decomposition  and  more 
powerful  search  mechanisms  will  have  to  be  incorporated  to  cope 
with  problems  of  traversing  a  large  data  base.  A  preliminary 
design  which  further  decomposes  this  level  into  two  levels  has 
been  proposed,  where  the  lower  level  is  responsible  for  fast 
search  in  a  flat  file  and  the  upper  level  is  responsible  for 
query  decomposition  and  linkage  of  data.  A  major  'surgery'  is 
expected  on  the  current  implementation  in  order  to  bring  about 
these  improvements. 
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6.3  THE  ENTITY  LEVEL  REVISITED 

The  main  purpose  of  this  level  is  to  build  semantics  and 
enforce  constraints.  One  powerful  arm  in  building  semantics,  the 
Virtual  Information  Facility,  is  largely  missing  in  the  current 
implementation.  This  facility  may  run  parallel  to  the  current 
level  on  a  'pipeline'  basis.  That  is,  retrieval  requests  will 
first  pass  through  a  'virtual  information  filter'  which 
transforms  the  request  into  one  which  contains  only  references  to 
actual,  stored  entities  and  attributes.  When  the  latter  has  been 
retrieved  by  the  RETE  facility,  the  return  data  will  go  through 
the  second  stage  of  the  virtual  information  facility,  a  'virtual 
information  encoder' ,  which  will  compute  the  virtual  information 
values  based  on  virtual  information  definitions.  Architecturally 
this  facility  could  lie  above  the  Entity  Level  and  form  a  Virtual 
Information  Level;  however,  data  structures  being  dealt  with  in 
this  facility  are  the  same  as  those  in  the  Entity  Level.  That  is 
to  say,  there  will  not  be  another  level  of  data  abstraction. 


6.4  LOCATION  AND  MANAGEMENT  OF  CATALOGUES  AND  WORKING  BUFFERS 

There  exists  a  spectrum  of  design  philosophies  for  a 


stratified  architecture.  On  the  one  extreme,  all  software  at  one 
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level  may  be  treated  as  'data'  at  the  next  level,  effecting  a 
hierarchy  of  levels  each  of  which  implements  its  'virtual  address 
space'  at  the  next  lower  level;  on  the  other  extreme,  the 


software  at 

one 

level 

is  divided 

into  two 

distinct  parts;  one 

part  (i.e.. 

code 

and 

catalogues) 

always 

exists  at  the  local 

level,  while 

the 

other 

part  (e.g., 

user  data)  always  exists  at 

the  next  level  (and  eventually  in  the  Storage  Hierarchy.) 

The  strategy  used  in  the  preliminary  design  of  the  Functional 
Hierarchy  is  somewhere  in  between:  catalogues  and  regular  data 
are  stored  as  data  at  the  next  lower  level  while  program  modules 
and  their  contexts  reside  within  a  level. 

Intuitively,  some  duplication  of  cataluge  and  data  within  a 
level  may  be  desirable  based  on  performance  considerations.  As 
the  FSTV  runs  show,  catalogue  retrievals  at  the  higher  levels 
consume  a  great  percentage  of  the  system  processing  power.  This 
overhead  may  prove  to  be  even  more  costly  if  the  database  is 
large  and  more  functionalities  are  incorporated. 

Another  aspect  in  this  issue  is  that  of  a  'stored  procedure' 
at  the  lower  levels.  In  other  words,  in  addition  to  storing  data 
at  the  next  lower  level,  a  level  may  choose  to  declare  some 
frequently  encountered  requests  to  the  next  lower  level,  so  that 
the  next  lower  level  may  have  some  specialized,  more  efficient 
code  to  process  them.  This  is  analoguous  to  a  'compiled  query' 
mechanism  adopted  in  System  R. 
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Yet  another  issue  is  that  of  a  'program  module  overfow' .  As  a 
level  develops  to  include  more  functions,  its  program  size  may 
become  too  large  to  be  all  stored  economically  within  the  level's 
local  memory.  Less  frequently  used  modules  may  be  removed  and 
stored  as  data  at  the  next  lower  level,  which  in  turn  will  store 
them  as  data  at  the  next  lower  level,  until  it  is  stored  as  part 
of  the  data  in  the  Storage  Hierarchy.  Similar  arguments  may  be 
devised  for  a  program  context  of  a  request  that  requires  a  large 
amount  of  buffer  space. 

However,  while  these  are  issues  FSTV  'as  exposed,  they  are  not 
likely  to  be  resolved  without  a  rigorous  investigation  of 
tradeoffs  among  alternatives.  It  also  requires  efforts  in 
designing  additional  algorithms  that  will  ensure  data  integrity 
in  the  case  of  data  duplication. 


PAGE  98 


REFERENCES 


Blumberg81:  Blumberg,  B.  INFOSAM  -  A  sample  database  management  system. 

Master  Thesis,  Sloan  School  of  Management,  MIT  (May  1981) 

Hsu80:  Hsu,  M.  A  preliminary  architectural  design  for  the  Functional 

Hierarchy  of  the  INFOPLEX  database  computer.  TR  # . MOT 0-807 1 -05 , 
Sloan  School  of  Management,  MIT  (Nove  1980) 

Madnick79:  Madnick,  S.E.  The  INFOPLEX  database  computer:  Concepts  and 
directions.  Proc.  IEEE  Computer  Conference  (Feb  1979) 

To81 :  To,  T.  Shell:  A  simulation  for  the  Software  Test  Vehicle  of  the 
INFOPLEX  database  computer.  Bachelor  Thesis,  Sloan  School  of 
Management,  MIT  (may  1981) 


l 

I 


page  TOO 


APPENDIX  I 

SAMPLE  TERMINAL  SESSION  (a) 


L* 


ATTRIBUTE  NAMES?  SEPERATE  BY  COMMAS.  USE  *  IF  ALL  ATTRIBUTES  ARE  DESIRED 


ENTITY  SET  NAME?  USE  ♦  IF  ALL  ENTITY  SET  NAMES  ARE  DESIRED. 


DBA:  DATA  DEFINITION  (DO)  OR  OATA  MANIPULATION  (OM)  OR  OATA  DEFINITION  QUERY  (OOQ)? 


ENTER  ATTRIBUTE  NAMES  ANO  PREDICATE.  SEPARATED  BY  COMMAS 


CREATE(CRT).  MODI F Y ( MOD ) ,  DELETE (DEL  )  ,  QUERY (DUE ) 


ENTER  NAMES  OF  ATTRIBUTES  SEPARATED  8Y  COMMA 


CREm  TE ( CRT ) .  MOO I F  V ( HOD ) ,  DELETE (DEL  )  ,  OUERY(OUE) 
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APPENDIX  I 


SAMPLE  TERMINAL  SESSION(b) 


ATTRIBUTE  DERTNAME  DEFINED 


NEW  ENTITY  SET  (NEW)  OR  EXISTING  ENTITY  SET  (OLO)? 


PRESS  ENTER  TO  CONTINUE 
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APPENDIX  2 

MACRO  DECLARATIONS 

(Control  Blocks,  Catalogues,  Entries) 

j 


J 


FILE:  DATA  MACLIB  A  VM/SP  CONVERSATIONAL  MONITOR  SVSTEM  PAGE  OOt 
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